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ABSTRACT 


The  transmission  of  digital  information  is  a  problem  that  has  attracted 
a  great  deal  of  interest  during  the  past  decade.  In  the  beginning,  transmission  rates 
were  lov/  and  the  accuracy  required  usually  not  too  well  specified.  As  digital 
communications  grew  in  sophistication,  the  requirements  for  increased  speed  and 
accuracy  in  transmission  grew  also. 

From  the  outset  it  was  assumed  that  the  speed  and  accuracy  of  trans¬ 
mission  was  limited  by  bandwidth  and  Gaussian  noise.  It  was,  soon  realized  that 
this  was  not  a  valid  assumption  for  many  systems.  In  particular,  in  the  case  of 
digital  data  transmitted  over  a  telephone  channel  it  was  observed  that  the  accuracy 
was  limited  by  noise  of  a  great  amplitude  that  occurred  only  seldom  and  occurred 
in  bursts.  This  type  of  noise  was  named  impulse  noise. 

It  was  observed  that  impvilse  noise  occurs  relatively  seldom  but  when 
it  occurs  it  is  of  an  amplitude  that  often  far  exceeds  the  signal.  These  observations 
were  put  to  use  in  the  design  of  suitable  signals  to  be  transmitted.  By  coding 
the  iiLformation  in  the  proper  ways  one  can  always  correct  the  bits  that  have  been 
corrupted  by  tlie  impulse  noise.  This,  however,  is  done  at  the  cost  of  adding  re¬ 
dundant  information  to  the  transmitted  signal.  Since  the  signaling  rate  is  limited  by 
the  bandwidth  of  the  channel,  this  results  in  lowering  the  effective  information  carry¬ 
ing  capacity  of  the  system.  By  constructing  very  long  codes,  this  lowering  of  the 
signaling  rate  can  be  raade  very  small.  Long  codes  on  the  other  hand  require  compl¬ 
icated  coding  and  decoding  equipment. 

This  is  where  we  presently  stand.  If  we  want  to  prevent  burst  of  impulse 
noise  of  a  certain  length  from  corrupting  the  transmitted  message,  we  must  choose 
a  balance  betv/een  reduction  in  channel  capacity  and  increased  equipment  complexity. 

The  investigation  carried  forward  in  this  thesis  looks  for  a  third  way 
out.  It  seeks  a  solution  to  the  problem  of  obtaining  the  maximum  transmission  rate 
subject  to  a  fixed  permissible  error  rate  and  a  fixed  equipment  complexity. 

The  method  by  which  this  is  accomplished  is  to  use  an  error  correcting 
device  (ECD)  that  examines  the  signal  for  signs  that  a  burst  of  impulse  noise  is 
likely  to  have  occurred.  The  bits  that  are  in  doubt  are  erased  and  replaced  by  use 
of  a  two-dimensional  parity  check.  This  method  allows  a  few  errors  to  pass  un¬ 
detected  by  the  ECD  and  will  therefore  give  a  small  but  definite  probability  of  errors 
in  the  presence  of  noise,  bursts.  Some  of  these  errors  can  be  corrected  if  the  code 
used  has  some  error  correction  capability. 


The  purpose  of  the  two-dimensional  code  which  is  used  here  is  to 
break  the  received  string  of  bits  up  into  sequences  that  are  used  as  rows.  By 
making  the  rows  sufficiently  long  the  probability  that  one  noise  burst  will  cause 
more  than  one  error  in  any  column  can  be  made  very  small.  A  figure  of  merit, 
M,  is  defined  by  which  different  transmission  systems  can  be  calssified  as  to 
burst  length.  The  problem  will  be  attacked  from  the  following  point  of  view. 

Given  a  permissible  probability  of  error  and  the  maximum  channel 
capacity  an  ECD  will  be  constructed  in  such  a  way  that  will  maximize  the  effect¬ 
ive  signaling  rate. 
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I.  INTRODUCTION 

a)  Digital  Data  Transmission 

The  transmission  of  digital  information  is  a  problem  that  has  attracted  a  great 
deal  of  interest  during  the  last  decade.  In  the  beginning,  transmission  rates  v/ere 
low  and  the  accuracy  requirements  usually  were  not  too  well  specified.  As  an 
example  of  this  we  may  take  teletype  transmission.  The  limits  of  acceptability 
might  vary  from  error  rates  of  one  error  every  other  line  to  one  error  per  page 
between  different  operators. 

Today  with  computer  to  computer  data  transmission,  very  much  lower  error  rates 
are  usually  required. 

In  the  early  analysis  of  data  transmission  systems  the  speed  and  accuracy  of  data 
transmission  was  assumed  to  be  limited  by  bandwidth  and  Gaussian  randum  noise. 

It  was  soon  realized  that  this  model  was  not  a  very  accurate  one.  Noise  of  a 
particularly  troublesome  kind  was  observed. 

This  type  of  noise  occurred  in  bursts  with  relatively  long  periods  of  quiet.  It 
had  a  peak  amplitude  very  much  greater  than  that  of  the  Gaussian  random  noise. 

Since  the  shape  of  these  noise  bursts  often  resembled  the  impulse  response  of  the 
transmission  channel,  this  type  of  noise  was  termed  impulse  noise. 

In  the  case  of  Gaussian  noise,  errors  occur  with  a  ra.ndom  spacing.  A  string  of 
consecutive  errors  is  therefore  not  very  likely.  Error  correcting  codes  such  as  the 
Hamming  code  were  developed  based  on  the  Gaussian  noise  model.  Since  the  most 
important  type  of  noise  turned  out  to  be  impulse  noise  where  the  probability  of 
consecutive  errors  is  very  great,  these  codes  did  not  perform  very  well. 

New  codes  were  developed  that  worked  well  in  the  presence  of  burst  type  noise. 
For  these  codes  to  be  effective  they  had  to  contain  a  large  number  of  digits  per  code 
block.  This  leads  to  very  complicated  coding  and  decoding  equipment.  For  this 
reason  these  codes  are  not  frequently  used  in  commxinications  systems. 

If  the  code  is  to  be  able  to  correct  long  bursts  or  several  bursts  in  a  short  time 
interval  the  redxmdary  added  to  the  information  digits  must  be  great,  thereby  causing 
the  effective  signaling  rate  to  be  low,  or  the  code  block  must  be  very  long  resulting 
in  very  complicated  equipment. 

Looking  for  a  way  to  avoid  some  of  the  problems  associated  with  lowering  of  the 
signaling  rate  or  equipment  complexity  this  investigation  seeks  a  different  solution 
to  the  problem.  The  m.aximum  signaling  rate  is  sought  subject  to  the  constraints  of 
a  given  error  rate  and  equipment  complexity. 
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b)  Organization  of  tlie  Investigation 

The  purpose  of  this  investigation  is  to  seek  a  more  efficient  solution  than  is 
presently -available  to  the  problem  of  reducing  the  effects  of  interference  to  data 
transmission.  More  efficient  in  the  sense  that  it  is  simpler  to  implement  or  requires 
less  redundancy  to  be  added  to  the  data  bits  caused  by  impulse  noise.  The  investi¬ 
gation  is  divided  into  two  parts.  The  first  part  deals  with  the  nature  and  statistics 
of  impulse  noise  and  the  selection  of  suitable  mathematical  tools  for  this  task.  This 
will  be  done  by  observing  certain  parameters  of  the  noise  and  forming  a  model  from 
which  these  parameters  can  be  obtained. 

The  second  part  of  the  investigation  is  concerned  with  a  system  which  we  will 
call  an  Error  Correcting  Device  (ECD).  The  parameters  obtained  in  the  first  part 
of  the  investigation  will  be  used  to  calculate  the  performance  of  an  ECD  system  and 
to  compare  the  performance  of  this  system  with  a  symmetric  binary  transmission 
system. 

Finally  there  are  some  ideas  on  how  the  performance  of  this  system  and  in 
general  any  digital  data  transmission  system  that  operates  over  a  nearly  linear 
channel  can  be  improved.  These  ideas  are  based  on  results  obtained  in  the  course 
of  this  investigation. 

c)  Impulse  Noise  Characterization 

The  communications  channel  under  investigation  can  have  either  a  linear  or  a 
non-linear  amplitude  response.  In  this  investigation  we  will  treat  only  the  linear 
case.  The  non-linear  case  can  be  treated  employing  similar  techniques  but  the  out¬ 
put  from  the  channel  must  be  evaluated  when  both  signal  and  noise  are  present  at 
the  same  time.  Many  channels  employing  active  elements  are  nearly  linear  over 
a  substantial  dynamic  range  and  will  therefore  also  fall  into  the  category  of  linear 
systems . 

Only  two  particular  types  of  channels  will  be  discussed  here.  They  are  the  channel 
which  has  the  transfer  functions  of  an  RLC  circuit  and  a  telephone  circuit  made  up 
of  type  N  carrier. 

Type  N  carrier  systems  have  widespread  application  in  the  Bell  Telephone 
System. 

The  two  most  important  parameters  of  impul.se  noise  are  the  number  of  bit 
intervals  it  takes  for  a  noise  burst  of  a  certain  peak  amplitude  to  decay  to  a  certain 
level  and  the  probability  distribution  of  the  peak  amplitudes  of  the  noise  bursts. 
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To  arrive  at  results  that  allow  us  to  calculate  these  parameters  we  will  use  the 
following  model  for  impulse  noise.  The  impulses  picked  up  by  the  channel  are 
assumed  to  be  perfect  impulses  and  the  resulting  channel  oulput  is  the  impixlse 
response  of  the  channel  between  the  point  where  the  impulse  entered  and  the 
observer. 

A  figure  of  merit  for  the  system,  M,  is  defined.  M  is  the  maximum  number  of 

g 

bits  that  may  be  in  error  due  to  a  noise  burst  resulting  in  a  certain ratio.  S 

is  the  peak  amplitude  of  the  signal  and  N  is  the  peak  amplitude  of  the  noise.  M 

S 

is  therefore  a  function  of  the  ^  ratio  but  comparison  can  be  made  between  different 
systems  once  a  value  for  ^  ratio  is  selected. 

M  can  be  evaluated  from  the  transfer  fimction  of  the  channel  for  the  various  data 
modulation  methods  that  may  be  used.  If  a  code  that  is  sensitive  to  burst  lengths 
is  used,  M  will  be  useful  in  synthesising  the  code.  M  is  a  suitable  figure  of  merit 
for  a  binary  system.  The  ECD  requires  that  the  received  signal  voltages  are  with¬ 
in  close  limits  of  its  expected  value.  Therefore  a  new  figure  of  merit,  M^^is 
defined  as  the  number  of  bit  intervals  the  noise  causes  the  voltage  to  deviate  more 
than  10  7o  from  its  expected  value.  The  peak  amplitude  distribution  of  the  noise 
bursts  is  also  of  great  importance  but  it  does  require  further  measurements  to  be 
made  on  the  channel.  In  this  case  instruments  have  been  built  at  Bell  Telephone 
Laboratories  and  at  MIT  Lincoln  Labs  that  are  triggered  on  each  noise  burst 
above  a  certain  level  and  measures  the  peak  amplitude  and  number  of  occurrences 
in  a  certain  interval  of  time. 

When  a  fxinction  that  closely  approximates  the  peak  amplitude  distribution  has 
been  selected  and  the  impulse  response  of  the  channel  is  known  the  probability 
density  function  of  the  sample  voltage  at  the  detector  output,  or  if  an  integrator 
is  used  at  the  integrator  output,  can  be  calculated.  The  probability  density  function 
of  the  noise  output  voltage  will  allow  probable  error  calculations  to  be  made.  In 
particular,  it  may  point  the  way  toward  improved  system  performance. 

d)  The  ECD 

The  ECD  is  a  system  that  is  designed  to  give  the  maximum  effective  signaling 
rate  in  the  presence  of  impulse  noise  and  subject  to  limitations  on  error  rate  and 
equipment  complexity. 

The  basic  ECD  consists  of  a  decision  device  with  tliree  regions,  one,  zero, 
and  erasure, used  in  conjunction  with  a  relatively  simple  error  detecting  code. 

Ideally  all  zeros  and  ones  are  correct  and  the  erasures  represent  suspisious  bits 
that  might  have  been  in  error.  The  erased  bits  are  replaced  cyclicly  by  a  shift 
register,  until  the  error  detecting  code  is  satisfied.  If  the  number  of  erased  bits 
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was  less  than  the  error  detecting  capabilities  of  the  code,  the  word  is  now  correct 
since  the  erasures  indicates  the  location  of  the  suspisions  bits  and  the  error  de¬ 
tecting  code  investigates  if  there  are  still  errors  present.  A  block  diagram  of  a 
digital  data  system  employing  an  ECD  is  shown  in  Fig.  1. 

Fig.  2  shows  a  probability  density  function  for  the  second  bit  interval  from  the 
start  of  the  impulse  burst  when  a  typical  telephone  channel  is  the  transmission 
medium.  The  sample  voltage  is  taken  at  the  integrator  output  when  a  zero  was 
transmitted.  Fig.  3  shows  the  probability  density  function  at  the  integrator  out¬ 
put  when  a  one  was  transmitted.  Actually  all  zeros  and  ones  are  not  error  free. 

To  make  the  analysis  more  accurate  these  errors  must  be  accounted  for  as  well 
as  the  errors  caused  when  the  number  of  erasures  exceeds  the  error  detecting 
capabilities  of  the  code.  To  improve  the  efficiency  of  the  ECD  by  minimizing  the 
effect  of  the  errors  in  the  zero  and  one  decisions  a  code  with  some  error  correction 
capabilities  is  used. 

In  the  example  used  in  this  investigation  a  code  with  a  single  error  correcting 
single  error  detecting  or  triple  error  detecting  capability  will  be  used. 
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n.  IMPULSE  NOISE  CHARACTERIZATION 

a)  Burst  Length  Analysis 

Digital  information  is  usually  not  transmitted  from  one  place  to  another  over 
large  distances  as  a  video  signal.  Usually  the  video  information  is  used  to  modulate 
a  carrier  in  some  way.  To  what  extent  the  transrrdtted  signal  is  contaminated  by 
impulse  noise  existing  in  the  channel  is  dependent  on  what  system  of  modulation  is 
used. 

At  the  outset  it  is  useful  to  define  certain  quantities.  The  signal  to  noise  ratio 

c 

will  be  defined  as  the  ratio  between  the  peak  signal  and  the  peak  impulse  noise 
voltages.  The  quantity  M,  a  figure  of  merit  of  the  transmission  system,  is 

defined  as  the  maximum  number  of  bits  that  may  be  in  error  due  to  an  impulse 
S 

resulting  in  a  certain  —  ratio. 

N 

Two  different  channels  will  be  investigated  for  the  burst  length  analysis.  The 
first  will  be  one  wi'th  the  response  of  a  simple  RLC  circuit.  This  approximation 
is  often  usable  as  a  first  approximation  to  systems  that  do  not  have  loaded  cables 
or  much  filtering.  The  second  type  channel  we  will  consider  is  a  type  N  telephone 
carrier  channel.  This  type  of  carrier  is  very  much  used  by  the  Bell  Telephone 
System  for  medium  distances. 

We  will  assume  that  each  noise  burst  is  caused  by  one  impulse  and  that  the 
frequency  of  occurrence  of  impulses  is  low  enough  so  that  we  do  not  get  overlapping 
bursts.  Experimental  evidence  obtained  by  Bell  Telephone  Laboratories  indicate 
the  validity  of  this  assumption.  The  bursts  are  assumed  to  be  caused  by  perfect 
impulses  so  the  received  noise  bursts  are  the  impulse  response  of  the  intervening 
part  of  the  channel.  It  will  be  shown  later  that  the  statistics  obtained  are  not 
excessively  sensitive  to  the  actual  noise  burst  shape  so  the  transfer  function  of  the 
intervening  part  of  the  chaimel  canfreqjentiy  be  taken  as  the  transfer  function  of  the 
whole  channel. 
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Ha.  !•  Channel  with  the  Response  of  an  RLC  Circuit 

Many  practical  transmission  systems  can  be  approximately 
represented  by  a  channel  with  the  transfer  function  of  an  RL.C  circuit.  Since  this 
channel  has  a  simple  impulse  response  it  is  well  suited  to  demonstrate  the  ideas 
behind  this  analysis.  This  type  of  channel  is  intx'oduced  her e  mainly  to  concentrate  the 
use  of  the  figure  of  merit,  M.  The  response  of  such  a  channel  to  an  impulse  is 

n{t)  =  Ae  cos  {  oo^t  +  0)  (2-1) 


The  parameters  a  and  w,  are  determined  by  the  transfer  function  of  the  systerp; 

A  is  a  function  of  the  energy  of  the  impulse.  T  and  Q  gives  the  timing  of  the 
occurrence  of  the  impulse.  The  impulse  noise  is  therefore  treated  on  a  mixed 
statistic  deterministic  basis.  The  shape  of  the  noise  bursts  itself  is  deterministic 
while  the  amplitude.  A,  and  time  of  occurrence,  as  given  by  T  and  9,  are  random 
variables. 

One  word  of  caution  is  required  here.  Since  the  noise  bursts  obtained  . 
using  the  proposed  impulse  response  model  for  the  phenomenan  are  not  exactly 
equal  but  only  very  similar  to  many  of  the  actual  noise  bursts  observed,  any 
attempts  to  take  advantage  of  this  knowledge  of  the  burst  shape  will  not  be  very 
eucessful. 

The  figure  M  will  now  be  calculated  using  several  different  modulation 
methods  and  using  the  RLC  channel.  For  more  complete  calculations,  the  reader 
is  referred  to  the  appendix. 


a.  AM  Envelope  Defector  -  System  I 
The  received  signal  is: 


s  (t)  =  (  1  +  cos 


w  t)  cos  w  t 
m  o 


Bit  interval  =  t 


(2-2) 


Time  required  for  the  noise  burst  to  decay  to  a  value  less  than  ^  as 
reqxiired  for  unique  determination  of  the  signal  in  an  on-off  carrier  system. 


t 


1 


a 


In 


2A 


TT 


In 


1  S 
“F  N 


(2-3) 

(2-4) 


M  is  independent  of  whether  a  string  of  zeros  or  a  string  of  ones  are 
transmitted. 
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b.  Vestigal  Sideland«  A^MtSynchronous  Detector  -  System  II 
n(t)  =  Ae  ^  cos  (w  +9) 


(cos  a>  +  cos  (co  +  CO  )  t 
o  o  m' 


CO  -  = 

CO 

+  a 

2 

0 

M  =  - 

2 

In 

1 

TT 

4 

(2-5) 

(2-6) 

(2-7) 


c*  AM.  sSynchronous  Detection  -  System  III 

XX  -  1  T  1  S 

IT  '  -2  N 

d.  PSK.'  Synchronous  Detection  -  System  IV 

s(t)  =S  cos  CjO  t 
'  '  o 


U  =  In® 


PSK.  Differential  Phase  Detector  -  System  V 

S(t)  =  S  cos  CO  t 
'  '  o 

Detector  output:  V(t)  =  cos  co^t  -  S^  cos  -  2irj 


M  =  1  -  1  I  n  I, 
TT  N 


(2-8) 

(2-9) 

(2-10) 

(2-11) 

(2-12) 

(2-13) 


When  we  use  the  simple  RLC  model  for  the  channel  we  obtain  a  closed 
form  expression  for  M  that  allows  direct  comparison  between  systems.  We  see 
for  instance  that  the  burst  length  in  a  PSK  system  is  one  bit  longer  when  a  differen¬ 
tial  phase  detector  is  used  as  compared  with  a  system  employing  synchronous 
detection. 

In  the  following,  in  connection  with  the  ECD,  we  shall  have  occasion  to 

use  a  quantity  M^>  is  defined  as  the  number  of  bit  intervals  it  takes  the 

detector  output  to  settle  down  to  within  i  10%  of  the  correct  signal  value*  When  M 

S  IS 

is  represented  in  closed  form,  i  s  found  simply  by  replacing -^by  -5-^ 


For  the  systems  studied  previously  we  obtain: 


System  I 
System  11 
System  III 


M  = - i —  In 

1  TT  »  ’ 


N 


+  -L  In  10 
TT 


-  —  In. 
TT  • 


4-  +  I-  1„  20 


(2- 14a) 
(2-l4b) 


Ml - ^  In  +  -^  In 


(2-l4c) 


8 


System  IV 

Mi=-  -i. 

4-  + 

1 

IT 

In 

5 

(2-14d) 

System  V 

Mi  =  -  4 

.In  4  ^ 

1 

TT 

In 

5  +  1 

(2-l4e) 

These  values  of  together  with  M,  for  an  actual  telephone  channel 
composed  of  type  N  carrier  are  plotted  in  fig*  6o 

The  values  used  for, plotting  the  curves  for  the  type  N  telephone  channel 
with  synchronous  demodulation  are  obtained  from  fig.  8,  9  and  10  and  from  the 
asymptotic  expression  for  the  impulse  response  of  a  telephone  channel.  Since 
those  curves  are  plotted  for  a  unity  peak  amplitude  noise  burst  they  represent  the 
actual  noise  output  voltage  from  a  symmetrical  binary  channel  with  a  unity  signal 
to  noise  ratio. 
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Ila#  2.  Ajctual  Telephone  ChanneL 

We  will  now  attack  the  problem  of  impulse  noise  bursts  in  an 
actual  telephone  carrier  channel.  If  necessary  the  problem  may  be  split  into 
two  parts.  One  transfer  function  can  be  used  for  the  carrier  channel  to  the  central 
office  and  another  from  the  central  office  to  the  subscriber#  In  this  way  the  noise 
burst  picked  up  along  the  carrier  channel  will  have  a  form- different  from  the  one 
picked  up  in  the  central  office.  If  an  open  wire  line  is  used  between  the  subscriber 
and  the  central  office,  this  may  be  necessary.  If  on  the  other  hand  loaded  cable 
is  used  for  this  run.  use  of  the  overall  transfer  function  will  usually  suffice. 

The  transfer  function  of  a  typical  medium  distance  telephone  connection 

containing  type  N  carrier  channels  is  represented  by  the  amplitude  and  phase 

2 

response  curves  shown  in  fig.  4  and  5. 

The  envelope  delay  of  this  channel  can  be  approximately  expressed  as: 

A  d  =  K  (1700  -  £)^  ('2-  15) 

Where  K  =  lO”^ 


The  corresponding  phase  vs.  frequency  response  is 

<t)=  /Ad  df  =  10"^  /(1700-f)^  df 

<|>  =  .  33  .  10"^  (£  -  1700)  ^  +  C 

Since  we  are  interested  only  in  relative  phase  distortion  we  may  set 

(j)  (1700)  =0  :  C  =  0  i 

And  obtain: 

<j)  =  .  33  .  lO-"^  (  £  -  1700)  ^  (2-  16) 

The  amplitude  response  of  the  channel  is  approximately  300  to  3000  cps. 
but  this  has  less  effect  on  the  transient  response  that  the  phase  distortion. 

We  will  assume  that  the  modulation  system  to  be  used  is  phase  shift 
keying  (PSK)  with  synchronous  detection.  This  system  was  shown  in  fig.  6  to  have 
the  best  figure  of  merit  for  the  HLC  channel  and  is  a  linear  system  where  super- 
possition  applies.  Since  the  synchronous  detector  is  a  linear  device,  our  channel 
will  appear  to  have  a  1300  cps  band  with  and  a  phase  function 

4)  =  .  33  .  10"'^  (2-17) 


When  viewed  from  the  video  output  terminals  of  the  demodulator#  the 


transfer  function  of  the  channel  can  therefore  be  approximated  by 

.  i  .  -a  cj  -  jb 
H  (  j  w  )  =  e  •' 


(2-18) 
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The  Gaussian  amplitude  characteristic  is  a  resonable  approximation  to  %.  5 
and  leads  to  a  closed  form  answer.  It  is  therefore  chosen. 


The  parameters  a  and  b  are  calculated  as: 

2  2  T 

^  “3db  = 


Q  3 

And  ,33-10"^  =  (2tr)b 


Therefore ' 


a  =  6.  7 


10 


b  =  1.  54 


10 


The  impulse  response  of  a  channel  with  the  transfer  funtion 
2  2  .  3‘  3 


y(t)  = 


t 


^  ^  \ 


1 

4.  7 


3  JT'  b 


a^t 

3b^ 


Jl  (u)  +  J  ^ 


2-19 

(u) 


T" 


T 


where: 

U  = 
1 

5  1 

y  (t)  ~  10  t  e 


3' 

-4  lot 


r  t  1  , a  .  4] 

3/2  L-B-  ■  7  J 


3/2 

5  3/2  5  3/2 

Jj  (2.  103  )  +  J  J  (2.  10  t  ) 

.  7  "7 


2.  10 


3/2 


t  in  sec. 


2-20 


This  expression  for  y{t)  even  though- it  is  in.closed  form  is  still  too 
complicated  for  easy  evaluation.  It  can  be  shown  to  be  closely  approximated  by  the 
^  ^ymptotic  expression: 

y  (t)  =  At  T  e  ^  ^  3t  ^  .  7  j  #  t  is  in  ms.  2-2  1 

for  t  >  2.5  ms. 

The  development  of  this  approximation  is  shown  in  the  appendix. 

A  plot  of  y(t)  for  o<t  <  2.5  ms  is  shown  in  fig.  8.  The  origin 
has  been  shifted  slightly  to  maJke  the  function  causal. 
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Ilb  Peak  Amplitude  Distribution  of  Impulse  Noise 

When  one  considers  the  various  ways  by  which  an  impulse  can  enter  the 
transmission  channel  one  concludes  that  impulse  noise  is  usually  picked  up  from 
the  electromagnetic  fields  generated  by  the  noise  source.  If  the  noise  source  was 
a  piece  of  wire  that  was  radiating,  the  potential  in  the  vicinity  would  be  roughly 
proportional  to  -  log  x  where  is  the  distance  between  the  pick  up  wire  and  the 
noise  source.  This  is  the  closest  form  of  coupling  that  would  exist  in  a  telephone 
plant. 

In  the  majority  of  cases  the  distances  between  the  noise  sources  and  sinks 
are  so  great  as  to  make  them  appear  more  nearly  as  point  sources.  This  is  the 
kind  of  coupling  one  would  expect  to  get  with  an  arching  relay  contact  or  with  a 
distant  thunderstorm. 

In  the  case  of  point  sources  the  resulting  potential  is  proportional  to  —  • 

1  ^ 

In  this  investigation  we  will  use  the  ^  law  for  peak  aimplitude  pickup. 

Besides  being  an  appealing  physical  concept  it  also  leads  to  expressions 
which  agree  well  with  experimental  evidence. 

In  the  following  we  will  assume  that  the  noise  sources  are  located  with 
probability  e  at  any  distance  away  from  the  point  where  the  noise  is  picked  up 
by  the  channel  but  that  the  noise  sources  are  restricted  to  lie  along  the  x-axis. 
All  impulses  are  assumed  to  be  radiated  with  the  same  strength.  Stronger 
impulses  can  be  considered  as  veaker  impulse  occuring  nearer.  This  assumption 
is  therefore  not  very  restrictive.  The  assumptions  about  the  geometrical 
arrangements  are  quite  reasonable  since  the  physical  layout  of  relay  contacts  is 
usually  as  a  row  and  in  the  case  of  overhead  wiring  it  follows  the  surface  of  the 
earth. 

We  will  call  the  peak  amplitude  of  the  observed  impulse  noise  burst, 

The  minimum  peak:  amplitude  that  is  counted  as  impulse  noise  is  V  ^  min 

is  the  voltage  resulting  from  an  impulse  occurring  at  a  distance  away  from  the 
channel.  Based  on  these  definitions  and  assumptions  we  obtain  the  following 
results : 


p{x)  =  e 

f  p  (x)  dx  =  E  = 

o 

V 

o 


V 

Vinirf  -  ^ 

o 

P(v)  =  P(x)  i^l 


1 


(2-22) 


(2-23) 


(2-24) 
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dv  =: 


P(v) 

P(v) 

P(v) 


X 

Y 


V  . 

min 


(2-25) 


where : 

oo  .  00 

/  P(v)  dv  =  1^1.  =1  • 

^min  min 

P(v)  is  therefore  a  properly  normalized  probability  density  function. 
To  compare  this  expression  with  available  data  we  must  find  the 
distribution  function  which  is  usually  the  quantity  that  is  measured. 


The  corresponding  distribution  function  is 

P(Vj)  .  P,  [  V  >  V,]  =  f  ^ 

V  . 

P(V^)=  (2^26) 


This  function  is  of  the  same  form  as  the  one  deduced  empirically 

from  experimental  data  by  Mertz  .  The  function  is  compared  with  data  published 

2  10 
by  Alexander  in  fig-  7.  Results  obtained  by  J.  H.  Fennick  at  Bell  Telephone 

Laboratoies  from  measurements  made  on  a  large  number  of  switched  telephone 

circuits  along  the  East  Coast  also  confirms  the  form  of  P(v).  From  these 

measurements  it  seems  like  an  equation  of  the  form 


would  fit  the  data  even  better-  As  will  be  shown  later,  in  the  section  on 
Deviations  from  the  Assumed  Conditions,  the  original  form  leads  to  more 
conservative  estimates  of  error  rates  and  will,  therefore,  be  used  in  the 
following  calculation  since  it  represents  an  upper  bound  on  the  observed 
phenomena.  The  question  of  the  exponent  of  V  will^lso  be  treated  under 
Deviations  from  the  Assumed  Conditions*  - 

In  telephone  systems  a  600  U  load  is  normally  used.  In  this  case  zero 
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dbxn  corresponds  to  .774  volts.  Using  Alexander's  d^ta,.to  determine  the 
constant  we  obtain  the  expression: 

p  >Vi]=  for  Vj>  V^i„  (2-27) 

This  corresponds  to  a  normalization  such  that  P  j^V  ^  vj  -  average 
number  of  impulse  counts  per  second  that  exceeds  V^.  In  this  case  a  15  mm. 
averaging  time  is  used. 

Fig-  7  shows  Alexander's  results  plotted  together  with 


And 


P  [v>  vj 

P  [v  >  Yj] 


=  .0024 

.000262 


V. 


(2-28) 


14 


lie •  Integration  Output  Voltage  Probability  Density . 

This  section  will  deal  only  with  the  telephone  channel.  The  same 
exact  method  can  be  used  in  the  case  of  any  linear  channel  and  modulation 
method.  In  the  case  of  a  nonlinear  channel  the  same  basic  method  of  approach 
can  be  used  but  it  will  be  necessary  to  handle  the  noise  and  the  signal  simul¬ 
taneously  since  superposition  does  not  apply. 

It  is  seen  from  fig.  6  that  the  figure  of  merit  for  the  system,  is 

considerably  improved  if  the  defector  output  is  integrated  before  sampling  as 
compared  to  a  system  simply  sampling  the  detector  output.  It  will  be  shown 
later  in  the  section  "Effect  of  Integration  on  the  Noise  Output  Voltage  from  the 
Demodulator”  that  integration  after  demodulation  greatly  reduces  the  expected 
burst  lengths.  This  section  will  also  go  into  the  reason  for  this  phenomenon. 


The  methods  used  apply  to  any  linear  system  even  though  the  spesific 
results  are  for  the  system  shown  in  fig.  1. 

If  an  impulse  occurs  within  a  bit  interval# its  peak  amplitude  and  time 
of  occurrence  within  the  bit  interval  are  random  variables.  Since  we  have  already 
selected  a  suitable  peak  amplitude  distribution,  what  remains  to  be  evaluated  is 
the  effect  of  the  randomness  of  the  time  of  occurrence. 

For  this  part  of  the  investigation  numerical  methods  were  used  with 
the  help  of  an  IBM  650  computer. 

The  impulse  response  of  the  channel  when  viewed  from  the  detector 


output  is 


y(t)  =  A  t 


l/2  -4l0t 
‘  e 


’  (2.  10 (2.  10 

.7  "7 


t  in  sec. 


(2-20) 


This  function  for  t  <  2.  5  ms  and  unit  peak  amplitude  is  plotted  in 

fig  •  8 . 

For  t  >2.5  ms,  the  asymtotic  form 
^  1 

y  (t)  =  - .  526  t  "  ^  e  •  j*  ^  ^  ^  in'ms.  (2-2  1) 

is  used.  For  computational  reasons  and  also  since  it  represents  a  logical  choice 
in  view  of  the  available  bandwith,  the  transmission  rate  will  be  chosen  equal  to 
1000  bits  per  second. 

We  will  assume  that  any  time  of  occurence  of  the  impulse  within  the 
bit  interval  is  equally  likely.  This  is  in  agreement  with  data  published  by  Mertz. 

The  first  calculation  to  be  done  is  the  evaluation  of  the  integrator 
output  due  to  a  unit  peak  amplitude  noise  burst  occurring  at  different  times  within 
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the  bit  interval.  Initially  a  power  series  approximation  to  y(t)  was  tried. 

This  power  series  was  integrated  and  evaluated  to  give  the  integrator  output  at 
the  sampling  intervals. 

This  method  was  found  difficult  to  work  with  and  gave  results  of 
insufficient  accuracy.  It  was  therefore  abandoned  and  numerical  integration  was 
used  instead. 


The  output  of  the  integrator  is  designated  Z.  is  the  output  at 
the  sampling  instant  at  the  end  of  the  n*th  interval.  The  impulse  response  was 
sampled  at  20  equally  spaced  times  with  the  1  ms  bit  interval  and  the  integral 
evaluated  as : 


^,n+l  20 

'n  k=l 


1 

Jo 


Yk- 


1 

w 


k  + 


l) 


(2-29) 


The  impulse  was  assumed  to  have  occurred  at  20  equally  spaced 
times  within  the  bit  interval. 

The  integrator  output  voltage  Is  evaluated  for  each  possible  time 
of  occurrence.  Fig/  9  and  10  shows  z  ^  and  z^  for  the  two  first  bit  intervals, 
as  a  function  of  time  of  occurrence  of  the  impulse  within  the  first  bit  interval. 

The  20  values  of  2  for  each  bit  interval  are  now  arranged  in 
increasing  order.  Since  each  of  the  20  possible  values  are  equally  likely,  each 
is  assigned  a  probability  of  From  these  values  the  probability  distribution 
function  of  Z  for  each  bit  interval  is  found.  P(  and  P(  z^)  are  shown  in 
fig.  1 1  and  12- 

The  functions  P(z^)  are  now  differentiated  to  obtain  the  corresponding 

density  functions.  ^-^id  p(Z^}  are  shown  in  fig.  13  and  14.  For  further 

calculations>  it  is  convenient  to  have  analytic  expressions  for  over  the 

various  bit  intervals  after  the  impulse  has  first  occurred.  This  is  conveniently 

done  by  curve  fitting  on  a  computer.  In  this  operation  considerable  care  must 

be  exericsed  so  that  the  resulting  polynomials  are  good  approximations  to  the 

desired  functions.  Since  no  further  differentiation  of  the  P  (z)  function  is 

n 

required,  the  requirements  are  not  nearly  as  strict  as  if  the  polynomials  had  to  be 
differentiated,  -n  (z)  is  now  in  the  form 

P:jj(z)  =  +  .••  a^z+a^  (2-30) 

The  output  from  the  integrator  due  to  a  noise  burst  of  unit  peak  amplitude 
is  Z.  Therefore,  the  integrator  output  due  to  a  noise  burst  of  peak  amplitude  V  is 
given  by: 

u  =  v  z  (2-3 1) 
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And: 


Since  Z  and  V  are  independent  random  variables 
P(z,  V)  a  P(z)  P(v) 

P(u,  V)  =  P(^)  P(v)  I  ^  I 


p(u)  S  j  p(u,v)  dv 
*-oo 

00 

P(u^)  =  /  p(u,v)  dv 

-oo 


(2-32) 


(2-33) 


On  different  occasions  the  probability  density  function  of  z  in  the  .iS*th 
interval  may  be  denoted. 

P(Zn)  according  to  which  notation  which  is  most  convenient. 

Substituting  the  expression  for  in  the  equation  for  obtain: 


oo  -i 

^  >  + .  ] 


dv 


(2-34) 


R  =:Max  of  V  .  .  or  “ 
'  min  z 


max 


P  (u)  K  Vmin 

■^n 


k  /  u  .  k 
FTT  + 


a 

o 

~7r 


1 


00 


— 2  I 

J  V 

Max  of  or  ^  ] 

^  ^  max-* 


For  u  <  Z:  V  .  '  we  obtain  a  k*th  order  polynomial  in  Plots  of 

—  max  min  ^  ^ 

P  (u)  and  P^(u)  are  shown  in  fig.  15  and  l6. 

J.  ^ 


The  most  interesting  also  most  useful  behaviour  of  p  (u)  is  for 

n 

^  ^  ^max.  '^min.  signal  levels  we  will  be  dealing  with  are  in  the  .  1  v  range 

As  can  be  seen  from  the  graphs  fig.  15  and  l6  Z  V  ,  is  less  than  1  mv 

max.  min. 

which  is  small  compared  with  the  expected  signal  leves  that  are  in  the  .  1  volt 
range.  Subject  to  this  condition  we  see  that 


Pn(u) 


V  . 

min 


ak 


+ 


/Z 


z 

max 


U 


2 


This  equation  is  of  particular  simple  form 
C 

P  (u)  =  ^  (2-35) 

n  c, 

u 


We  see  that  the  form  of  equation  2-35  does  not  depend  on  the  actual 
impulse  waveform  in  the  asymptotic  region. 

It  is  easy  to  show  that  this  is  true  for  any  p(z)  as  long  as  the  function  is 
well  behaved. 
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fort 

But: 


=  r  P>)P(v)dv 
u 

7r - ^ 

max 

^  >  Z  V'  • 

max  min. 

u  =  zv 


Therefore: 


=  I  P^tJ)  P(V) 


dy 

I'vl 


V 


P(v)  - 


Let: 


Since  u  is  a  constant  in  the  integration 

dv  _  A  /  \ 

_  u  -j  -  ..  d  (-) 

V 


=  L 


(2-36) 


(2-37) 


I’n(-)  =  I  P.(I^) 

u  o 

The  integral  in  equation 
Therefore : 

Y  . 

p  (u)  =  - ^ .  const 

n  '  d 

u 


is  a 


{  2-38) 


(2-39) 


and  the  statment  is  proved. 

In  the  appendix  an  approximate  method  by  which  p^  can  be  quickly 
approximated  without  the  use  of  a  computer  is  developed.  This  method  allows  a 
quick  estimate  of  the  impulse  noise  performance  of  a  particular  system  before 
more  accurate  calculations  with  the  aid  of  a  computer  are  carried  out. 
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'JOINT  PROBABILITY  DENSITY  FUNCTIONS 


p^(u)  is  the  probability  density  function  for  the  integrator  output 
voltage  that  is  in  effect  in  the  n'th,  bit  interval  after  the  start  of  the  impulse, 
regardless  of  what  happened  in  the  previous  n- 1  bit  intervals.  For  many  types  of 
codes  it  is  important  to  have  a  probability  function  relating  the  va.rious  bit  intervals. 
For  this  reason  the  joint  probability  density  function  for  the  noise  output  voltage 
from  the  detector  at  the  sampling  instants  will  be  developed.- 

In  developing  the  joint  probability  density  function  we  will  use 
numerical  methods  in  a  similar  way  as  was  done  for  *  Let  m  and  n  denote 

two  bit  intervals. 


m  >  n 

We  evaluate  and  z^  for  20  equally  spaced  times  of  occurrence  of  the  impulse 

in  the  first  bit  interval.  Next  we  select  the  corresponding  values  of  z  and  z 
and  form  the  function 


z 

m 


(2-40) 


If  the  function  2-40  is  well  behaved  and  single  valued  the  conditional  probability 
density  of  given  z^  is 

p(z  1  z  )  =  6  fz  -  f(z  )1  (2-41) 

The  probability  density  of  z^  was  calcultated  in  the  previous  section.  The  joint 
probability  density  of  z^  and  z^  is  therefore: 

Since  z^  is  independent  of  v  we  see  that 

p(z  ,  z  ,  v)  =  p(z  ,  Z  )p  (v)  (2.-43) 

n  m  n  m 

We  are  ultimately  interested  in  the  probability  density  of  and  and  must 

therefore  make  a  change  of  variables- 


*7  ^ 

=  f 

(W) 

—  V  ^ 

m 

,  Zi  — 
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Here  is  a  dummy  variable  introduced  only  for  the  purpoce  of 

making  the  transformation  between  equal  numbers  of  variables.  We  obtain  the 
probability  densities  of  the  u' s  as 


p(u^  , 

u 

m 

.  u^)  =  P(Z^ 
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We  now  are  in  a  position  to  obtain  our  desired  result 


r  1 

p(  u  ,  u  )  =  J  p(z  ,  z  ,  v)  ----  dv 

n  m  rT  n  m  '2 

0  V 


(2-45) 


(2-46) 


(2-47) 


Because  of  the  impulse  in  equation  2-41  ,  equation  2-47  reduces  to 

,  u_)  =  (^)  p(v„)  -L 


(2-49) 


where  v  is  the  solution  to  the  equation: 

u 

U  -  V  £(-i?:.)  =  0 

m  o  V 

o 


From  equation  2-49  we  can  form  an  expression  for  v^  in  terms  of  the  U' s.  for 

values. of  U  and  U  subject  to  the  conditions: 
n  m 


0  <  u  V  .  Z 

n  min  n  max 


0  <  u  V  .  Z 

m  mm  m  max 


V  =  F  (u  ,  u  ) 

o  n  I  m  '  n  m' 


(2-49) 


Upon  substituting  this  solution  back  into  equation  2-48  an  introducing  the  probability 
density  of  v^  we  obtain  the  final  result. 


p(u  ,  u  ) 
^  n  m 


V  .  (F  ) 
min  n  i  m 


•n  'F  , 

n  m 


)  (2-50) 


n 


u 

m 


) 


To  conclude  this  section  it  is  of  interest  to  investigate  p(u 
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for  the  most  critical  intervals i  ti  —  1  i  m  —  0  .  As  a  first  order  approximation  to 
equation  2-40  we  obtain: 


0  <  <  .  5 

0  <  2^  < . 5 

From  equation  2-51  we  obtain 

=  2  (Uj  +  up  (2-52) 

Substituting  >2  back  into  equation  2-50  we  get 


P(wi 


^2^ 


We  not 


16(  Uj  +  U2) 

that  equation  2-53  is  of  the  form 


T  Pn 


Ui+  U2 


(2-53) 


P(uj.  U2)  =  f(ui  .  xxj 

This  expression  is  seen  to  be  similar  to  the  asymptotic  expression  for  p  (U)  which 
is 

Pn^ 

u 

Since  it  is  a  function  of  two  bit  intervals  one  might  rescnably  expect  equation  2-54 
to  be  to  the  fourth  power  rather  than  the  second. 

p(u^,  u^)  will  not  be  used  in  the  synthesis  of  the  ECD  system  since 
the  correlation  between  errors  in  adjacent  bit  intervals  is  not  of  importance  here. 

It  is  needed  for  evaluate  the  performance  of  certain  codes  and  also  to  evaluate  the 
imporovement  in  performance  that  can  be  expected  using  the  method  described  in 
the  section  "Further  Improvements  of  the  ECD"  . 
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SYNTHESIS  OF  THE  ECD 
The  ECD  system  receiver 

The  ECD  system  receiver  is  shown  in  fig-  20.  The  modulation  method  that 
will  be  used  is  phase  shift  keying  (PSK)  since  this  system  lends  itself  well  to  analysis 
and  has  the  shortest  burst  lengths.  The  maximum  transmitted  signal  level  on  a 
telephone  channel  is  -4dbm.  This  will  be  assumed  to  be  the  transmitted  power  level. 
The  average  loss  over  a  medium  distance  telephone  circuit  is  15  db  resulting  in  a 
channel  output  level  of  -19dbm.  Into  a  600f2  load  this  is  .123  volts  peak.  The  output 
from  the  synchronous  detector  is  therefore  +.  123  V  corresponding  to  a  zero  and 
123  V  corresponding  to  a  one.  Since  the  integretor  has  a  gain  of  1000,  and  the 
integration- time  is  one  ms,  the  integrator  output  is  +.  123Vfor  a  one  and  123V  for 
a  zero  in  the  absence  of  noise.  The  integrator  is  followed  by  a  decision  device  with 
three  output  leads.  The  decision  as  to  which  lead  should  be  activated  is  based  on  the 
integrator  output  voltage,  u,  at  the  sampling  instant  as  shown  in  figs.  2  and  3. 

Estimation 

When  a  noise  burst  occurs  and  a  digit  is  transmitted  we  do  not  know  that 
the  burst  has  occurred  nor  do  we  know  what  the  transmitted  digit  was.  We  must 
rely  on  the  detector  or  in  this  case  the  integrator  output  at  the  sampling  instant  to 
inform  us  about  the  likelihood  of  what  noise  voltage  has  been  picked  up  and  which 
bit  was  transmitted-  The  sample  voltage  may  be  in  one  of  five  regions  corresponding 
to  one,  zero  or  the  three  erasure  regions.  Consequently  we  are  faced  with  the 
problem  of  testing  between  three  possible  hypothesis. 

This  problem  can  be  simplified  by  taking  advantage  of  the  symmetry  involved 
in  this  situation  as  shown  in  fig.  2  and  3.  Since  a  one  and  a  zero  are  mutually  exclus¬ 
ive,  only  one  of  the  two  probability  densitites  1)  (W  0)»  can  be  in  effect. 

We  will  assume  that  zeros  and  ones  are  equally  likely  as  is  usually  the  case  in  binary 
communications  systems.  By  taking  advantage  of  the  symmetry  we  will  reduce  the 
three  possible  choices  to  two. 

We  will  choose  as  our  two  possible  hypotheses  that  the  output  from  the 

detector  is  correct,  H,,  or  that  it  is  incorrect,  H  .  H,  therefore  includes  the 

1  o  i 

cases  where  the  received  bit  is  the  same  as  the  transmitted  bit  and  when  an  erasure 
is  received  regardless  of  what  was  transmitted.  only  includes  the  case  where  the 
received  bit  is  the  opposite  of  the  transmitted  bit.  This  corresponds  to  the  case 
where  the  decision  device  does  not  catch  an  error  and  is  knows  as  an  error  of  the 
first  kind.  We  will  designate  this  type  of  error  by  a  or  where  n  refers  to  the  bit 
inferval  since  the  start  of  the  impulse. 
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When  a  signal  is  received  we  will  designate  the  probability  of  the  erasure 
in  the  received  bit  interval  or  by  P  or  We  are  now  ready  to  apply  the  hypothesis 

test  to  the  integrator  output 

b 

"■n"  (u/O)  du  (3-1) 

a 

where  a  and  b  are  the  decision  thresholds  as  shown  in  fig.  2  and  zeros  and  ones 
are  equally  likely.  The  probability  of  an  erased  bit  in  the  n'th  bit  position  is 

-b  a  oo 

(V  1)  du  +  /  (u/ 1)  du  +  /p^  (u/ 1)  du  (3-2) 

-  Qo  -a  b 

according  to  figs  3^ 

Since  we  can  make  the  approximation  that 

a  oo 

~  -I"  '  1)  du  +  /  p^  (u/  1)  du  (3-3) 

-OO  b 

The  code  that  will  be  used  in  connection  with  this  investigation  is  a  25  x  32  bit  code 
which  breaks  up  the  bursts  as  far  as  the  coding  is  concerned  since  the  error  correc¬ 
tion  is  done  along  the  columns  while  the  bits  are  read  in  along  the  rows.  For  this 
reason  the  correlation  between  errors  or  erasures  is  the  same  burst  are  of  no 
importance  to  the  average  error  rate  since  the  arrangement  of  bursts  within  the 
code  block  is  random.  This  subject  is  discussed  by  Feller  and  others. 

As  will  be  shown  in  the  section  on  coding,  errors  in  the  output  can  be 
caused  by  an  excess  of  errors  of  the  first  kind  or  an  excess  or  a  combination  of 
both.  It  will  be  shown  that  the  error  rate  E  equals: 

E  =  Ep  +  E  ^  (3-4) 

Where  Ep  are  errors  caused  by  an  excess  of  erasures,  E^  are  errors  caused  by 
an  excess  of  errors  of  the  first  kind  and  .  The  object  of  the  decision  test  is  to 
minimize  E.  An  analytic  method  for  this  might  be  worked  out  but  would  be 
analytically  complicated  and  successive  trials  has  been  chosen  as  a  relative¬ 
ly  quick  way  to  solve  the  problem.  The  solution  can  be  obtained  the  following  way. 

a)  Select  a  value  for  a* 

b)  Calculate  the  minimum  value  of  p  for  this  value  of  cl. 

c)  Evaluate  the  error  rate  E. 

d)  Repeat  the  calculations  for  a  different  value  of  a. 
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This  method  will  quickly  lead  to  an  optimum  choice  of  a  and  b,  the  decision 
thresholds,  such  that  E  is  a  minim \irn. 

As  a  guide  rule  to  the  selection  of  a  value  for  a  that  will  minimize  E  the 
following  statement  can  be  made. 

E  will  be  close  to  its  minimum  value  when 


E 


a 


s  E 


aP 


(3-5) 


That  this  is  so  can  easily  be  seen  if  one  realizes  that  there  exists  an  inverse 
relationship  between  E^  and  Ep.  Let  us  assiune  that  E^ 

Ep  will  increase.  A  point  is  reached  when  Ep  will  account  for  most  of  the  errors. 
Since 


E  =  E  +Eo  +  E« 
a  p  ap 


(3-6) 


the  error  rate  will  be  almost  independent  of  E^  and  nothing  will  be  gained  by  increas¬ 
ing  Ep  further. 

It  is  therefore  to  be  expected  that  the  error  rate  is  close  to  a  minimum  when 
the  three  terms  are  about  equal. 

If  E^p  is  very  different  from  E^  and  Ep  the  code  that  is  used  is  probably  not 
the  most  efficient  under  the  given  circumstances.  We  will  now  show  the  method  by 
which  the  calculations  of  optimum  threshold  are  carried  out. 

Since  we  are  not  concerned  with  correlation  between  errors  the  probability 
of  an  error  of  the  first  kind  is  appriximately: 

n 

a  =  X)  (3-7) 

n=  1 

As  we  see  from  fig.  19»  this  sum  converges  very  rapidly.  We  need  therefore 
only  take  into  account  the  three  first  terms. 


tt  =  (3-8) 

In  the  case  of  the  telephone  channel  we  are  investigating,  we  have  shown 
that  the  signal  levels  at  the  output  of  the  integrator  can  be  expected  to  be  .123  volts 
at  the  sampling  instant.  The  probability  densities  at  the  output  of  the  integrator  at 
the  sampling  instant  due  to  signal  plus  noise  when  a  zero  was  transmitted  are 
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calculated  as  previously  explained  to  be: 

.-4 


P|  (u/  0) 


P2  (u/  0)  = 


P3  (u/  0) 


2.07.10' 

(u  +  .  123)" 


-4 


4.55.10 
(u  +  .  123)" 


4.  09.  10~_ 
(u  +.  123)" 


u  <  -.  125 
or 

u  >  - . 121 


(3-9) 


We  notice  that  p^  (\j/  0)  is  already  small  campared  io  p^^  (u/  0). 

The  probability  densities  of  the  integrator  output  due  to  signed  and  impulse 
noise  for  the  three  first  bit  intervals  following  the  occurrence  of  the  impulse  are 
calculated  to  be: 


2.07.  10“ 


P(  (u/  1)  =  - 7- 

(u  -  .  123)"^ 


P2  (V  = 


4.55. 10" 

(u  -  .  123)" 

-6 


(u  -  .  123)^ 


125 


<  .121 


(3-10) 


After  making  several  tries  it  was  found  that  a  =  2.  10“  results  in  an  error 
rate  which  is  close  to  a  minimum.  This  value  of  a  will  therefore  be  used  to  illustrate 
the  method  by  which  the  threshold  values  are  selected. 

The  problem  is,  given  a=  2.  10  find  threshold  levels  a  and  b  such  as  to 

make  p  a  minimum.  The  probability  densities  as  given  by  eq-  (3-9)and  (3- 10)are 

3 

for  a  one  sec.  interval.  Since  the  bit  rate  is  10  bits  per  sec.  eq.  (3-9)  and  (3-10) 

-  3 

will  be  multiplied  by  10  to  give  the  respective  probability  densities  per  bit.  This 
is  in  good  agreement  with  experimental  data  reported  both  by  Mertz  and  Fennick. 

We  will  assume  that  a  one  was  transmitted  and  calculate  the  probability  of 
receiving  a  zero. 


Since  p^  (u/  0)  is  of  the  same  form  for  all  n  we  can  sum  before  we  integrate 
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and  obtain: 


a 

n 


b 

C  du 

C  J  - T 

a  (U  +  .123) 


(3-11) 


"  a  +  !  123  "  'bTTTiy 

-7 

This  equation  is  plotted  in  fig.  18  for  a  =  2.  10  to  show  clearly  the  relation¬ 
ship  between  a  and  b  for  a  fixed  a. 

Any  combination  of  a  and  b  along  this  curve  will  result  in  the  same  value  for 
a.  The  desired  value  is  the  one  that  minimizes  p. 

a  00 

P=c/  - 2-  +  (3-13) 

-00  (u  -  .  123)  b  (u  -  .  123) 

where  c  =  Ci  +C-,  +  c,  since  :  c  <  <  1  for  n  =  li  2,  3. 

12  3  n 


p  =  c 


.  123  -a  b  -  .123 


(3-14) 


This  equation  is  plotted  as  a  function  of  a  for  a  =  constant  in  fig.  18. 

Fig.  18  now  allows  us  to  choose  the  optimum  values  for  a  and  b.  Fig.  18 
also  shows  how  sensitive  the  erasure  rate  is  to  threshold  location. 

From  the  values  obtained  for  a  and  p  the  error  rate,  E,  can  be  calculated 
as  is  shown  in  the  section  on  Error  correction  capabilities  of  the  code. 

This  process  can  now  be  repeated  until  a  minimum  value  for  the  error  rate 
is  obtained. 

For  the  case  of  the  telephone  carrier  channel  under  discussion  and  for 
-7 

a  =  2.10  the  minimum  erasure  probability  is  any  one  bit  interval  is  found  to  be 
-4 

p  =  i.  5.  10  .  The  corresponding  error  rate  is  calculated  in  the  appendix  to  be 
E  =  i.  9«  10  .  In  this  case  the  threshold  values  are  seen  from  fig.  18  to  be 

a  =  .125 

b  =  .133 

with  the  channel  centered  at  +  -  123  volts  for  one  and  zero- 

It  is  of  interest  to  note  that  the  threshold  levels  are  not  symmetrically 
located  with  respect  to  the  signalling  levels. 


f 
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Coding 

The  code  that  will  be  used  in  this  investigation  is  a  two  dimensional  block 

code  with  one  simple  parity  check  along  each  row  and  a  cyclic  Hamming  code  along 

each  column.  This  type  of  code  was  picked  because  of  simplicity  of  implementation 

and  its  suitability  for  the  task  in  question.  The  received  bits  are  read  serially  in 

along  the  rows.  Since  the  errors  due  to  impulse  noise  tend  to  come  in  bursts  the 

rows  are  made  longer  than  the  longest  bursts  that  can  be  expected.  The  maximum 

burst  length  equals  M  for  a  simple  bymmetric  binary  channel  or  approximately 

for  the  ECD  system.  From  the  peak  amplitude  distribution  we  can  determine  the 

maximum  peak  amplitude  noise  that  will  occur  sxifficiently  seldom  to  be  tolerable. 

S 

This  gives  us  the  minimum  1;^  ratio  that  may  occur  and  subsequently  an  max 

can  be  found.  To  be  on  the  safe  side  we  may  let  the  rows  be  from  two  to  several 

times  M. 

1  max. 

In  the  particular  example  used  to  illustrate  this  investigation  it  is  seen  from 
fig.  6  that  a  ratio  of  lO"”  is  required  to  give  rise  to  a  burst  lasting  six  bits.  By 
extrapolating  fig.  7  we  find  that  the  probability  of  this  happening  within  a  one  second 
interval  is  1.5.  10  if  we  use  curve  II. 

-7 

It  is  important  to  make  a  distinction  here.  1.5.10  is  not  the  probability 
of  a  six  bit  long  burst  but  the  probability  that  such  a  burst  is  at  all  possible.  The 
major  part  of  the  error  control  is  done  along  the  columns.  Since  the  probability 
that  one  burst  will  cause  two  errors  or  erasures  in  the  same  column  is  vanishingly 
small  we  can  consider  the  errors  along  the  columns  to  be  independent.  The  code 
therefore  allows  the  errors  or  erasures  to  be  considered  as  if  they  were  caused  by 
random  noise. 

Let  the  code  block  have  m  rows  and  n  columns.  The  redundancy  along  each 
column  is : 

R  =  —  (3-15) 

w 

where  w  is  the  number  of  information  digits  per  column  and  m  is  the  total  number 
of  digits  per  column.  The  number  of  check  bits  is  k  where: 

k  =  m  «-  w  (3-  16) 

To  construct  a  single  error  correcting  code  we  proceed  as  follows:  Since  the 
checking  number  must  indicate  which  bit  is  in  error  and  what  it  should  have  been 
the  checking  number  must  describe  m  +  1  different  things. 


27 


Therefore: 


2^  >  w  +  k  +  1 


or 


,w  ^  2 

2  1 


(3-17) 


(3-18) 


By  use  of  this  inequality  we  can  determine  the  least  amount  of  redundancy  required 
to  construct  a  code  that  will  be  able  to  correct  a  single  or  detect  a  double  error*  K 
we  add  one  additional  check  bit  to  the  column  this  code  will  be  able  to  detect  three 
or  correct  one  and  detect  one  error. 

g 

From  fig.  6  and  7  we  see  that  a  ratio  of  one  resulting  in  not  more  than  a 

maximum  of  6  erasures  will  happen  very  infrequently-  As  was  calculated  in  the 

beginning  of  this  section  on  coding  conditions  for  this  porribility  will  exist  only 
-7 

1.5.10  of  the  second  interval.  A  row  length  of  25  bits  is  therefore  sufficient  to 
break  up  the  bursts. 

To  minimize  the  redundancy  of  the  rows  let  us  satisfy  the  inequality  with 


where 


u  +  w  =  p 

p  +  1  =  2"^ 


(3-19) 

(3-20) 


This  equation  is  satisfied  for 


p  -  31,  u  =  5,  w  =  26 

resulting  in  a  column  with  26  information  bits,  a  5  bit  Hamming  code  and  one  parity 
check  hit.  The  final  code  block  is  a  25  x  32  bit  matrix.  It  has  the  capacity  to 
detect  any  three  or  correct  one  and  detect  one  bit  per  column. 
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Error  Correcting  Capability  of  the  Code 

The  code  as  developed  in  the  previous  section,  consists  of  a  25  x  32  bit 
matrix.  Each  row  has  24  information  digits  followed  by  a  parity  check  bit.  The 
code  block  is  transmitted  rov/  by  row. 

Each  column  is  constructed  of  26  information  bits  followed  by  5  bits  which 
together  forms  a  one  bit  error  correcting  Hamming  code.  The  column  is  completed 
with  a  parity  check  bit.  The  32  bit  column  vector  can  be  viewed  as  a  number  in 
32  dimensional  space. 

To  clarify  the  geometric  picture  let  us  take  a  three  digit  code  word  abc  which 
represents  a  vector  in  three  dimensional  space.  The  various  numbers  that  can  be 
represented  by  this  word  are  the  lattice  points  of  the  cube  shown  in  fig.  21.  We 
see  that  there  are  four  combinations  that  have  even  and  four  combinations  that  have 
odd  parity.  To  make  a  single  error  detecting  three  digit  code  we  can  use  the  last 
digit  for  parity  check.  Let  us  select  odd  parity.  In  this  case  all  the  white  spheres 
represent  valid  code  words.  When  this  code  is  working  with  the  ECD,  a  single  erased 
bit  can  always  be  replaced  cyclicly  and  the  correct  code  word  will  be  found  by  the 
parity  check  system-  If  two  erasures  have  occurred  such  a  replacement  is  no 
longer  unique.  To  clarify  this  let  us  investigate  a  specific  case. 

Assume  that  a  lOO  was  transmitted  and  that  a  xxO  was  received.  When  the 
two  first  bits  are  replaced,  both  combinations  OlO  and  100  will  be  acceptable  to  the 
parity  checking  registers.  In  the  first  case  two  errors  are  committed,  in  the 
second  case  no  errors  are  made.  The  average  number  of  errors  committed  is 
therefore  one  per  code  word. 

From  this  analysis  we  can  generalize.  In  a  code  with  an  N  error  detection 
capability  and  Q  erasures,  all  erasures  can  be  replaced  as  long  as  Q  <  N  in  the 
absence  of  errors.  This  is  clear  since  the  erasures  indicate  where  a  possible 
error  is.  The  suspected  bits  are  now  replaced  cyclically  until  the  code  indicates 
that  no  errors  are  present.  If  Q  >  N,  as  many  as  Q  errors  may  be  committed  in 
any  one  code  word.  The  average  number  of  errors  committed  in  a  large  number  of 
code  words  is  Q  -  N. 

For  the  25  x  32  bit  code  all  cases  of  E  ?  or  ???  along  one  column  can  be 
corrected.  Here  E  indicates  an  error  and  ?  an  erasure.  If  four  erasiires  occur 
along  one  column  one  wrong  bit  will  result  on  the  average.  If  one  error  and  two 
erasures  fall  in  the  same  column  one  error  will  also  on  the  average  result. 

Based  on  this  reasoning  we  will  assume  all  erasures  exceeding  the  detecting 
capabilities  of  the  code  to  result  in  errors. 
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The  probability  of  one  erased  bit  per  bit  interval  is; 

p  (1)  =  Pj  +  P2  +  P3  -  P1P2  -  ^2^3  -  P1P3  +  P1P2P3  (3-21) 

if  we  neglect  for  u_>  4. 

During  a  time  le£;s  than  one  second  p  (u)  is  approximately  proportional  to 

n 

time.  For  long  intervals  of  time,  1  -  p^  (u)  has  a  hyperbolic  distribution.  The 
probability  of  one  erasure  in  any  particular  bit  interval  is  therefore: 

P  (i)  =  Pi  +  P2  ■^^3 


since  3  <<  1  for  all  n. 

n 

Since  at  least  four  erased  bits  are  required  per  column  to  give  one  error  on 
the  average,  the  probability  of  an  error  due  to  this  cause  is; 

?T'28'J  (3-23) 

p^  |4|  is  the  probability  of  committing  one  error  on  the  average  due  to  four  erasures. 
Correspondingly  p^  I  sj  is  the  probability  of  committing  on  the  average  two  errors 
due  to  five  erasures. 


Pr{5}=  [p  (^)]^  -rrrrr 


(3-24) 


The  error  rate  due  to  this  erasure  pattern  is: 

,3 


lO' 
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E  - 


Pr{4}+2p^  {6}+3p^{6}  + 

Z  n  p  {3  +  nj 
1=  1  ^ 


(3-25) 

(3-26) 


Errors  can  also  be  generated  if  there  is  more  than  one  error  per  coliamn  or  one  error 
and  more  than  one  erasure. 


The  probability  of  two  errors  in  a  column  is: 


where 


P^{2e}=[p  (IE)]  2 


(3-27) 
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p  (IE)  =  +  a3  -  -  a2a3  -  a^a3  +  a^a2a3 

«  aj  +  +  a3 

The  probability  of  one  erasure  and  two  errors  is: 

p^{2,  1e}  =  [p  (IE)]  [p(l)]^  1^1 
Continuing  this  reasoning  for  a  greater  number  of  erasures  we  obtain: 

3 

TT  _  10-^  y  r  +  n  32.' 

^a,|3"  ^  L  np  (IE)  [p  (1)J  (2  +n)J  (30  -  n.)J 

n—  1 

The  error  rate  is  now 

‘E  =  E  +  E  +  E  « 

a  p  a,  p 


(3-28) 


(3-29) 


(3-30) 


(3-31) 
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The  ECD  Integration  of  the  Detector  Output 

The  threshold  levels  that  will  be  used  here  are  the  ones  that  were  found 
to  result  in  a  minimum  overall  error  rate 

Errors  of  the  first  kind 


b 

~  du  =  2.07 

a 


i  1 

.“123  +  .  115  "  7T?J+“ ,  f33 


.  10 


-7 


(3-32) 


=  .302.2.07.  10"’^=  .625.  lO"”^ 
b 

a^=  f  p2  (u/o)  du=  .  302.4.  55.10"’^  (3-33) 

a 


=  1. 374.  10"^ 
b 

=  J  p  (u/'o)  du=  .302.4.  09.  10"'^  (3-34) 

a  3 

=  .0124.  10"’^ 


a  0  foj*  n  >  4 
n  “ 


Erasures  or  errors  of  the  second  kind 


P  j  (u/  1 )  du  +  /  p  ^  (u/  1 )  du  =  2.  07 ,  1 0 

-00  b 


p,  =  2.  07.  10"’^.  225  =  .  66.  10" 


-7 


.  123  -  .  115 


;  12?  2'  .  issj 


(3-35) 


a  oo 

^2  =  /  P2  (V  1)  du  +  /  P2  (u/  1)  du 
-00  b 


(3-36) 


P2  =  4.55. 10"^. 225  =  1.023. lO"^ 
a  00 

P3  =  J  P3(u/l)du+/  p,  (u/ 1)  du 

-OO  b  ^ 

p2=  4.  09.  10"'^.  225  =  .0092.10"'^ 


(3-37) 


0  <  <  p,  for  n  >  4. 
^n  i 
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and  represents  the  average  nvunber  of  errors  or  erased  bits  per  bit  interval 

due  to  the  n*th  bit  interval  following  the  bit  when  the  impulse  occurred.  For  short 

time  intervals  the  probability  of  an  error  is  approximately  proportional  to  the  length 

of  the  interval  if  only  one  error  is  counted  per  burst.  This  was  shown  in  data 
3 

published  by  Mertz. 

The  probability  of  one  incorrect  bit  per  interval  is  approximately: 

a  =  +  as 

a  =  2. 10"^ 

The  probability  of  one  erased  bit  per  bit  interval  is : 

p  =  +  P3  -  P1P2  "  ^2*^3  -  P1P3  +  P1P2P3  <2-38) 

P=  1.5-I0“^ 

The  error  rate  calculated  on  this  basis  is  carried  out  in  the  appendix  and  is  found 
to  be: 


E  -  E  +  E.  +  E^^ 
a  p  ap 


E  =  (.63  +  .70  +  .57)  .  10 
E  =  1.9.  10"^ 


-9 


(3-39) 


E  is  the  average  number  of  incorrect  bits  in  the  output  per  second. 
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Comparison  of  Error  Rates 

The  ECD  system  v/ill  be  compared  with  two  other  digital  data  transmission 
systems.  The  first  is  a  simple  binary  system,  the  second  is  the  same  system  but  with 
the  addition,  of  an  error  correcting  code  with  the  same  correction  capabilities  as 
the  one  used  with  the  ECD  system.  The  row  length  in  this  code  can  be  reduced 

since  for  a  symmetrical  binary  channel  the  figure  of  merit  is  M  rather  thanM^ . 

S  ^ 

Since  corresponds  to  a  five  times  as  great  as  the  one  needed  for  M  we  see 

from  fig.  6  that  for  a  telephone  channel  with  integration  of  the  detector  output 

M  =  5.  3  bits  corresponds  to  =  6  bits.  Since  the  code  was  choosen  to  have 

S  ^  -4 

4  +  i  bits  per  row  for  a  =  10  the  code  used  with  a  symmetrical  binary 

channel  could  have  a  length  of  23  rather  than  25  bits  for  the  same  performance. 

This  last  system  would  be  further  simplified  since  no  memory  for  the  erasures 
would  be  required. 

Symmetric  Binary  Channel 

In  this  case  all  errors  of  the  first  kind  are  real  errors  and  the  threshold 

level  is  zero  volts.  Assume  zeros  and  ones  are  equally  likely. 

3  o 

Z  /  Pjj(u/l)du  (3-40) 

n=  1  -00 

2. 07.10"^  ^  4. 55.  10“^  ^  4.  09.  IQ"^ 

.123  .123  .123 

E  =  5.  3.  10*’^ 


E  = 


E  = 


Symmetric  Binary  Channel  with  a  23  x  32  bit  Code  Block 
30 

Z 

k=  1 

E  =  4.  4.  10"^ 


Z  f 

n=  1  -00 


(u/  1 )  du 


k  +1 


(k+l)M3l^-  k).' 


10^ 

~32' 


(3-41) 


Comments 

From  these  calculations  we  can  see  the  relative  performance  of  the  three 
systems  subject  to  the  same  amount  of  impulse  noise.  We  see  that  the  ECD  system 
is  best  with  about  2.  lO  incorrect  bits  per  second.  The  symmetric  binary  channel 

.7 

using  the  23  x  32  bit  code  is  second  with  an  error  rate  of  4.  10 
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The  symmetric  binary  channel  with  no  error  correction  is  worst  with  an 
-  3 

error  rate  of  5.  10  wrong  bits  per  second* 

4 

The  second  best  system  has  improved  the  error  rate  by  a  factor  of  10  at 
the  cost  of  a  redundancy  of  1.23  and  some  equipment  complexity. 

The  ECD  further  improved  the  error  rate  by  a  factor  of  about  200  without 
additional  redundancy  at  the  cost  of  a  modest  increase  in  equipment  complexity. 

Effect  of  Integration  on  the  Noise  Output  Voltage  from  the  Demodulator 

We  will  now  investigate  the  effect  on  the  noise  voltage  available  at  the 
decision  device  with  and  without  first  integrating  the  demodulator  output  voltage. 
To  do  this  we  wil]  evaluate  the  probability  of  error  for  a  simple  symmetrical 
binary  channel  due  to  impulse  noise  for  various  bit  positions  after  the  impulse 
first  occurred.  We  will  first  treat  the  case  where  we  sample  the  demodulator 
output.  The  channel  is  the  telephone  channel  we  have  been  analyzing  where 


zero  =  -.123  volts 
one  =  +.  123  volts 


The  average  error  rate  per  second  is  approximately 

a  =  a,  +  a-  +  +  .  .  .  .  =  A  a 

i  2  3  j  I, 


N 


since  errors  are  mutually  exclusive  and  is  a  small  number.  Correlation  between 
bit  intervals  is  not  important  if  we  are  interested  in  the  average  error  rate. 


"  f  Pi  (V  ' 


"•2- 2.93.10-3 


o 

00 


2.  123 


°-2  ~  f  P?  “ 


=  1.36.10-3 

2.  123 


a  =  /  P„  (u/  0)  du  = 


5.4.  10" 


. 123.2 


^[+1 


>  3 


4. 32.  10 
Tn+T 


-3 


(3-42) 


The  probability  of  an  error  due  to  the  impulse  noise  burst  in  the  n’th  bit  interval  is 
shown  in  fig.  1 9« 
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We  will  now  calculate  the  error  rate  for  the  same  channel  with  the 
difference  that  the  detector  output  voltage  is  integrated  before  it  is  sampled. 
In  this  case: 

00  . 

a,  -  J  p ,  (u/  0)  du  =  -  t  =  1.69-10 

o  2  (u-.  123)  '  o 


.-4  00 


=  /  P?  (V  0)  du  =  ^  -  I  =  3.  95.  10 

2  (u-. 123)  o 


-3 


o 

00 


-6 


a  =  /  p  (u/  0)  du  =  —  i  =3.33.10 


2  (u-. 123) 


(3-43) 


For  n  >  4  becomes  neglibly  small. 

These  values  of  error  rate  in  the  various  bit  intervals  after ’the  start  of  the 

_  3 

impulse  are  plotted  in  fig.  19-  The  error  rate  for  the  first  system  is  a=  4.  11.  10 

-  3 

while  the  second  system  has  an  error  rate  of  5.42.  10  .  The  error  rate  is  therefore 

not  significantly  different  for  the  two  system  when  no  coding  or  error  correction  is 
being  done.  If  some  error  control  method  is  used  that  depends  on  short  burst 
lengths  fig.  19  shows  that  the  situation  is  quite  different.  While  there  is  practically 
no  difference  in  the  probability  of  making  an  error  in  the  two  first  bit  intervals  after 
the  start  of  the  noise  burst  the  probabilities  become  very  much  favorable  for  the 
system  employing  the  integrator  once  the  second  bit  position  is  passed. 

The  reason  for  this  phenomenon  is  that  once  the  catastrophic  part  of  the 
impulse  is  over  what  remains  are  mainly  the  high  frequency  components  of  the 
noise  burst.  These  components  are  approximately  normal  to  the  signal  over  the 
bit  interval.  Integration  over  the  bit  interval  will  therefore  result  in  a  very  small 
detector  output. 

The  reason  why  the  high  frequency  components  of  the  noise  burst  arrive 
late  is  the  phase  distortion  of  the  channel- 

Since  integration  of  the  detector  output  will  tend  to  result  in  fewer  wrong 
bits  caused  by  a  given  impulse  noise  burst  it  can  be  considered  optimum  in  the 
sense  that  it  is  better  than  direct  sampling  of  the  detector  output  voltage. 


o 
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Implementation  of  the  Code 

A  coding  system  of  the  type  discussed  in  this  thesis  might  conveniently 
be  implemented  around  a  magnetic  core  or  tunnel  diode  memory  with  a  capacity  of 
800  bits.  The  row  vectors  containing  24  information  bits  and  one  parity  check  bit. 

The  generator  polynomial  for  this  code  is 

^  (X)  =  X  +  1 

The  circuit  symbols  that  will  be  used  are  shown  in  fig.  23. 

A  circuit  that  will  generate  a  code  with  equation  3-44  as  its  generating  function 
is  shown  in  fig.  24. 

The  input  is  connected  to  the  transmitter  coder.  The  row  vector  is  being 
stored  as  it  is  being  transmitted.  Following  the  24  information  bits,  the  content 
of  the  shift  register  stage  is  transmitted  to  make  up  the  parity  check.  The  26  row 
vector  containing  the  information  digits  are  transmitted  during  a  650  ms  interval. 

After  626  ms,  all  the  information  digits  of  the  first  column  vector  have  been 
transmitted  and  the  error  control  bits  for  the  first  column  can  now  be  calculated. 

Since  the  column  vector  is  constructed  with  26  information  bits  in  the  first  places 
we  can  form  a  complete  column  vector,  F,  by  filling  the  rest  of  the  spaces  with 
zeros.  The  six  parity  check  positions  now  make  up  an  additional  vector,  R.  By 
use  of  the  Euclidian  division  algorithm 

s  (x)  =  d  (x)  g  (x)  +  r  (x)  (3-45) 


we  can  form  the  complete  column  vector.  If  we  let  s  (x)  =  F  the  information 
column  vector  and  let  r  (x)  =  R  equal  the  parity  check  vector,  we  can 
obtain  the  column  vector: 

f  (x)  -  r  (x)  =  d  (x)  g  (x)  (3-46) 


Here  g  (x)  is  the  generator  polynomial  for  this  code.  The  parity  check  vector  is 
therefore  calculated  as  the  remainder  in  the  calculation 


f  (x) 
g  (x) 


(3-47) 


This  calculation  can  be  done  by  synthesising  a  circuit  that  will  divide  a  polynomial 
by  g  (x).  First  we  must  determind  g  (x).  Since  there  are  32  bits  in  the  code  and 
all  bits  equal  to  zero  is  not  a  valid  code,  g  (x)  must  be  a  root  of 


32 

X 


1=0, 


(3-48) 
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This  expression  can  be  factored  as 


32  .  ^  /  26  ,  24  ^  18,  16^  10,  8^  2^.. 

X  -l-(x  +X  +X  +X  +X  +X+X+1) 
(x^  +x'^-fx  +  1)  (x  +  1) 


(3-49) 


bearing  in  mind  that  +  and  -  have  the  same  meaning  modulo  two.  Since  we  have 
six  parity  check  bits  our  division  polynomial  must  be  of  sixth  degree.  We  can  there¬ 
fore  let 


g  (x)  =  (  +  x"^  +  X+  1)  (x  +  1) 


=  x  +x  +x  +1 


(3-50) 


We  can  now  proceed  to  synthesize  a  circuit  that  will  divide  a  polynomial  of  32  degree 
by  g  (x)  and  storing  the  remainder. 

The  circuit  in  fig.  25  operates  as  follows.  The  gate  G  is  closed.  The  data 
bits  from  the  coluiim  being  processed  are  read  out  from  the  matrix.  They  are  not 
needed  for  further  use  so  this  can  be  done  destructively  if  this  is  most  convenient. 
After  the  26  data  bits  have  been  read  in  ,  -R  has  been  calculated  by  the  circuit  and 
is  stored  in  the  shift  register.  Since  addition  and  subtraction  modulo  two  are  equiv¬ 
alent  we  now  have  R.  G  is  now  opened  and  the  error  control  bits  are  shifted  out  from 
the  shift  register  and  placed  in  the  last  six  rows  of  the  dolumn  vector.  This  process 
continues  until  column  25  is  reached. 


To  see  the  sequential  operation  of  the  matrix  and  the  coding  circuit  more 
clearly  let  us  retrace  its  functions. 

As  the  data  bifs  are  being  transmitted  to  the  channel  they  are  also  being  stored 
in  the  matrix.  The  bits  are  transmitted  by  rows.  Simultaneously  the  circuit  in 
Fig.  24  calculates  the  row  check  bit  used  to  complete  each  row.  Since  this  bit  is 
not  needed  again  they  need  not  be  stored.  The  transmitter  memory  need  therefore 
only  be  a  32  X  24  matrix.  As  soon  as  the  last  data  bit  of  the  first  column  has  been 
transmitted,  the  corresponding  error  control  bits  can  be  calculated. 

This  process  continues  for  the  rest  of  the  rows  as  they  become  ready  for  it. 
While  the  problem  of  coding  is  fairly  straight  forward,  the  problem  of  decoding  is 
much  more  complex.  The  reason  for  this  is  that  while  the  transmission  is  done  in 
a  binary  system,  three  different  symbols  are  available  at  the  detector  output.  First 
of  all  a  matrix  capable  of  storing  trinary  digits  must  be  available.  Such  a  matrix, 
could  be  made  up  of  Esaki  diodes  as  shown  in  fig.  26. 


T 
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In  this  memory  all  cells  would  be  set  to  zero  at  the  beginning  of  the  cycle. 

As  the  various  bits  come  in,  a  circuit  as  shown  in  fig.  24  will  calculate  the  row 
parity  check.  The  result  of  this  calculation  is  compared  with  the  received  check 
bit  and  both  are  stored  at  the  end  of  the  row.  This  can  only  be  done  if  no  E  signals 
have  occurred.  If  it  does  not  check  an  E  is  stored. 

This  process  is  continued  until  the  whole  transmitted  word  has  been  received. 
When  this  has  happened  there  are  two  possible  groups  of  occurrences. 

A)  No  erasures  have  been  received  . 

B)  One  or  more  erasures  have  been  received. 

We  will  first  consider  A.  The  fact  that  no  erasures  are  received  does  not  necessarily 
mean  that  no  errors  have  been  committed.  It  is  therefore  necessary  to  check  the 
rowSi  The  generator  polynomial  for  the  row  code  was: 

g(x)  =  (x  -h.  1 )  (  +  X  +  1)  (3-51) 

Since  this  polynomial  can  be  factored  as  shown,  the  two  factors  can  be  calculated 
separately.  The  checking  of  the  code  can  therefore  be  done  by  the  circuit  shown 
in  fig.  27 . 

The  column  vector  under  test  is  fed  from  the  matrix  to  the  circuit  shown  in 
fig.  4.  As  soon  as  all  the  symbols  have  been  read  from  the  column,  the  checking 
calculations  are  finished.  If  r  (1)=  r  (a)  =  0  it  is  assumed  that  no  erx'or  has  occurred. 
If  r  (1)  =  1,  r  (a)  ^  0  it  is  assumed  that  a  single  error  has  occurred.  This  error 
is  corrected  by  reading  once  more  the  digits  from  the  stored  column  vector  and  at 
the  same  time  moving  the  shift  register  with  no  input.  When  the  combination  lOOOO 
appears  in  A,  the  incorrect  bit  is  just  coming  out  of  the  matrix.  This  bit  is  inverted 
and  the  error  is  corrected. 

If  r  (1)  =  1  and  r  (a)  =  0,  a  multiple  error  has  occurred.  This  kind  of  error 
may  be  corrected  by  observing  the  row  checks.  If  any  of  the  row  checks  failed  it  will 
be  assiamed  that  the  errors  occurred  at  the  intersection  of  the  corresponding  rows  and 
columns.  This  check  can  not  be  carried  out  until  all  the  columns  have  been  checked. 
Now  the  cross  check  can  be  carried  out. 

If  one  or  more  erasures  have  occurred  we  are  confronted  with  case  B.  In 
this  case  the  column  check  of  any  columns  without  erasures  should  first  be  carried 
out  and  possible  errors  corrected.  Following  this  the  procedure  explained  under  case 
A  will  be  repeated  by  replacing  the  erased  bits  sequentially  with  zeros  and  ones  until 
all  the  checks  are  found  valid.  This  process  can  be  simplified  if  in  addition  to  storing 
erasures,  information  is  stored  about  whether  the  erased  bit  was  closest  to  a  zero 


or  a  one. 
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Discussion  of  Other  Impulse  Noise  Error  Control  Methods 

As  a  result  of  this  investigation  into  the  nature  and  effects  of  impulse  noise, 
results  have  been  obtained  that  are  valuable  in  evaluating  the  performance  of  various 
channels  and  impulse  noise  control  methods.  From  the  plot  of  the  figure  of  merit  of  the 
system,  as  seen  in  fig.  6  we  see  that  the  system  which  has  the  shortest  impulse 

response  is  the  best  in  the  sense  that  it  will  cause  the  least  amount  of  consecutive 
wrong  digits.  To  obtain  a  short  impulse  response,  the  amplitude  cutoff  of  the 
channel  should  be  gentle?  and  the  phase  distortion  as  small  as  possible.  From 
fig.  19  we  see,  however,  that  integration  of  the  detector  output  will  greatly  decrease 
the  effects  of  phase  distortion  since  the  received  impulse  noise  is  approximately 
normal  to  the  signal  after  the  first  two  or  three  bit  intervals. 

Clipping  of  the  Received  Signal 

Clipping  is  a  frequently  used  method  to  combat  the  effects  of  impulse  noise. 

If  the  energy  from  the  impulse  is  stored  in  the  transmission  channel,  such  as  the 
case  is  in  most  telephone  channels,  clipping  will  merely  cause  distortion  of  the 
received  signal  and  be  of  little  value.  If,  on  the  other  hand,  the  receiver  contains 
filters  that  can  store  the  received  energy  .  srer  several  bit  intervals,  clipping  at  a 
level  slightly  above  the  signal  will  probably  improve  the  system  performance 
considerable . 

Smear  Desmear  Filtering^"* 

The  effect  of  smear  de smear  filtering  is  to  distribute  theenergy  of  the  impulse 
over  several  bit  intervals.  If  no  error  correction  is  done  by  the  system,  this  method 
will  cause  a  trade  of  several  single  bit  errors  for  fewer  longer  bursts  occurring 
more  seldom  since  the  basic  principle  of  smear-desmear  filtering  is  to  spread  the 
energy  in  the  impulse  over  several  bit  intervals. 

While  this  may  be  an  efficient  trade  off  if  no  error  correction  is  done,  the 
trade  off  is  not  a  good  one  if  a  simple  error  correcting  code  is  used. 

If  clipping  and  smear  desmear  filtering  is  employed,  the  performance  of  the 
system  can  be  considerably  improved.  Such  a  system  is  shown  in  fig.  28. 

In  the  system  shown  in  fig.  28,  data  v/hich  is  modulated  onto  an  appropriate 
carrier  is  passed  through  a  smear  filter,  possibly  one  with  severe  phase  distortion. 

The  output  of  the  channel  passes  an  equalizer  which  equalizes  for  the  phase  distor¬ 
tion  of  the  channel.  This  will  shape  up  the  impulse  response  so  that  maximum 
advantage  can  be  obtained  from  the  clipper. 


i 
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The  clipping  level  should  be  set  only  slightly  higher  than  the  data  level. 
From  the  clipper,  the  data  is  passed  through  a  desmear  filter,  possibly  one  with 
the  inverse  phase  response  of  the  smear  filter,  and  is  further  passed  on  to  the 
demodulator . 


While  a  system  such  as  depicted  in  fig.  28  has  probably  great  merit  in  any 
data  transmission  system,  further  investigations  of  it  will  not  be  carried  out  here 
since  they  are  outside  the  scope  of  this  investigation. 

Deviations  from  the  assumed  conditions 

It  is  of  interest  to  investigate  what  the  effects  of  variations  from  the  assumed 
probability  law  for  v  •  l>et 

P  =  A  A  ^min  (3-52) 

...  V  V 


where  - 1  <  A 


(u)=2aA/  p(a^ 


V  . 
mxn 


V  ^  "3+"A 

V 


dv 


(3-54) 


P(n/v)'  can  be  expanded  in  a  power  series. 


1-1 
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a~>  Z 
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a-  <  Z  . 
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where  Z  and  Z  .  are  obtained  from  the  given  impulse  response, 
max  min  o  j- 

By  use  of  (3-55),  equation  (3-54)  becomes: 
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Since  the  first  condition  is  true  only  for  very  small  values  of  u  "  *  00Z4 

and  we  are  primarily  interested  in  the  effects  on  voltages  of  magnitudes  much 
greater  than  this,  we  will  only  explore  the  second  condition.  If  the  second  condition 
is  applied  to  equation  (3-56)  we  obtain: 

00 


p  (u)  =  a  A  / 


n  j 

n+3+A  •  •’"1 

V  V  V 


max 


p  (u)  =  a  A 


_ n _ u 

n  +  2  +  A  n+2+A 


dv  (3-57) 
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If  we  let 
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b  Z  n+2+A  b.  Z 
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We  see  that  K  is  regular  if  a  ^  0  and  A>-2.  Both  of  these  conditions  agree  well 
with  our  previous  conditions  and  results.  We  can  therefore  write  equation  (3-49)  as: 
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The  probability  of  committing  an  error  in  any  particular  bit  interval  is  : 

b  +  .  123 


-  =  / 
n  ■' 


K  , 
n. 

'"n  "  1  +  A" 


a  +  .  123 

1 


p  (u)  du 


(a  +  .  123)^  (b  +  .  123)^ 


(3-61) 
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As  Ah^-1,  the  error  rate  a$  given  by  equation  (13)  becomes  indeterminate. 
In  order  to  determine  Lim  ad  A-v-1  we  apply  L' Hospitals  theorem  and  obtain 


T  '  r,  -  IT  1  b  +  .  123 

Lim  a  =  K  In  — r — rrr 

n  n  a  +  .  123 

A-^-1 


(3-63) 


From  equation  (3-62)  we  also  see  that  no  finite  value  of  A>-1  will  cause  any  sudden 
changes  in  u* 

From  equation  (3-63)  we  see  that  the  error  rate  is  a  well  behaved  function  of 
A  that  does  not  depend  critically  on  any  partievdar  assumed  value. 

The  error  rate  a  is  as  can  be  seen  from  equation  (3-62)  proportional  to 
Kn  which  again  is  proportional  to  may  therefore  at  first  glance  seem  like 

the  estimate  of  this  value  is  very  critical.  The  voltage  V  .  =  pV  is,  however, 

quite  well  defined  since  it  represents  the  amplitude  threshold  which  is  exceeded  or 
reached  on  the  average  once  a  second.  It  should  therefore  not  be  excessively 
difficult  to  obtain  a  rather  good  estimate  of  this  value. 

It  is  of  interest  to  see  how  much  our  results  would  have  been  changed  if  we 
had  used  A  =  +  1 . 

If  A=  0: 
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If  we  let  A  =  1 : 
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For  the  limiting  case  A=  -1: 


_  ^  .  b  +  .  123 

n  a  +T123 


(3-66) 


Obtaining  numerical  values  to  facilitate  the  evaluation  of  these  results  when 

a  =  .  115  ,  b  =  .  133 
we  obtain  from  equation  (3-64) 
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From  equation  (3-65) 
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From  equation  18 


a  =  K  In 
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.256 


-=  .  07K 
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(3-69) 


This  result  is  not  unexpected  since  for  all  three  cases,  the  average  number  of 
impulses  per  unit  time  and  there  minimum  amplitude  is  fixed.  Since  a  more  positive 
A  indicates  that  the  picked  up  noise  decreases  more  rapidly  with  distance,  we  would 
expect  a  greater  nunaber  of  stronger  impulses. 

10  . 


Experimental  evidence  indicates  that  A  ^  0  is  the  usual  case, 
reason  we  will  consider  in  more  detail  the  case  where  A=  1. 
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If  the  two  probability  distributions  are  fitted  to  the  experimental  data  at  the  point 
where  they  cross : 
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But: 
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If  we  use  the  equality: 
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is  the  voltage  at  which  the  two  curves  intersect.  In  the  present  case  =  .109 
volts.  Equations  (3-67)  and  (3-68)  can  therefore  be  directly  compared. 


“•Zf  0  •  ^  =  0 
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a  .  ,=  1.2 

A=  1 
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=  .  131  K 
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(3-79) 


“•A=  1  1  -  °-A=  0  (3-80) 

We  notice  that  for  A>  0  the  error  rate  decreases  somewhat  compared  to  the  case 
when  A=  0.  Since  not  enough  data  is  as  yet  available  to  justify  using  A>  0  we  will 
use  A=  0  and  the  results  obtained  are  therefore  on  the  conservative  side. 


Further  Improvements  of  the  ECD 

The  results  obtained  by  use  of  the  ECD  in  the  previous  described  manner  look 
very  promising.  There  is,  however,  still  room  for  improvements.  Since  in  order 
to  commit  an  error  when  a  one  was  transmitted,  u  most  satisfy  the  requirement. 


123  -  b  =  u  <  -  .  123  -  a 
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This  condition  implies  that  the  probability  for  the  next  bit  to  be  erased  is  very 
great  since  noise  burst  of  large  amplitude  must  have  occurred.  We  can  calculate 
the  probability  that  an  error  will  be  followed  by  an  erasure  by  use  of  the  joint 
probability  function  ^^m’  Instead  of  actually  calculating  this  probability 

we  can  make  a  good  estimate  of  it.  If  the  one  is  followed  by  a  one  we  see  from 
fig.  11  and  12  that  for  the  two  first  bit  intervals  u  does  not  change  sign.  Therefore 
since  the  probability  of  an  erasure  during  the  second  bit  interval  is 

p2  =  i  -  ^2  (3-81) 


in  this  particular  case.  An  error  in  the  first  bit  interval  is  therefore  always  followed 
by  an  erasure  or  error  in  the  second  bit  interval.  Since  two  consecutive  errors  are 
not  very  probable,  the  conclusion  is  that  an  error  in  the  first  bit  interval  is  almost 
always  followed  by  an  erasure  in  the  second  bit  interval.  The  converse  is  also  true.  An 
error  in  the  second  interval  is  almost  always  proceeded  by  an  erasure  in  the  first 
bit  interval. 


From  this  reasoning  it  is  seen  that  the  efficiency  of  the  system  could  be 
improved  by  in  addition  to  the  erased  bits  also  erasing  the  bits  immediately  proceeding 
and  following  the  erased  bits. 


Detailed  calculations  of  the  magnitude  of  this  improvement  has  not  been 
carried  out.  The  procedure  is  to  calculate 
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where  m  =  n  +  1  — 

The  magnitude  of  this  improvement  is  uncertain  and  furthermore  it  is  uncertain 
vdiether  the  additional  equipment  complexity  would  warrant  it. 

The  method  for  finding  the  optimum  threshold  leaves  +  a  and  b  the  same 
as  was  used  for  the  ECD  system. 


46 


Comments 

Based  on  the  calculations  carried  out  in  this  investigation  we  can  construct 
an  ECD  system  that  using  a  25  x  32  bit  block  code  will  give  an  error  rate  of  2.10'"^ 
errors  per  second  under  adverse  conditions  of  impulse  noise.  The  code  used  in 
this  system  has  a  redundancy  of  1.23. 

The  symmetric  binary  channel  operating  with  the  same  signal  levels  and 

subject  to  the  same  amount  of  interference  would  have  an  error  rate  of  5.  lO  errors 

per  second.  If  the  same  25  x  32  bit  code  block  that  is  used  with  the  ECD  is  used  in 

-7 

combination  with  the  symmetric  binary  channel,  the  error  rate  drops  to  4.  10  and 
the  redundancy  is  1.23. 

The  ECD  system  is  therefore  seen  to  give  an  improvement  in  error  rate  of 
200  with  no  additional  redundancy  or  slowing  down  of  the  signalling  rate.  This  gain 
is  made  at  the  cost  of  a  modest  increase  in  equipment  complexity. 

The  ECD  giving  this  improvement  in  performance  has  threshold  levels  of 
+  .  115  and  4  .  133  volts*  when  the  expected  signal  level  is  .  123  volts.  The  average 
number  of  erasures  is  .  15  per  bit  interval  per  second. 

The  example  of  an  ECD  system  worked  through  in  this  thesis  is  a  very  simple 
one  using  a  linear  symmetric  binary  channel  and  phase  shift  keying  with  synchronous 
detection.  This  is  done  to  show  clearly  the  method  of  approach  rather  than  to  solve 
a  specific  problem.  The  method  is  quite  general  and  can  be  applied  to  other  systems 
such  as  FSK  or  Kineplex  with  equal  validity.  Since  the  results  obtained  using  these 
two  modulation  methods  will  be  more  complex,  it  is  felt  that  the  chosen  system  is 
preferable  in  order  to  demonstrate  the  basic  approach  clearly. 

The  results  obtained  agree  well  with  experimental  evidence,  particularly 
that  obtained  by  J.  H.  Fennick  at  Bell  Telephone  Laboratories  from  measurements 
made  on  switched  telephone  lines  at  various  points  along  the  east  coast.  The 
agreement  is  less  with  data  obtained  from  circuits  where  saturation  effects  are 
important.  Some  workers  in  the  field  have  also  counted  errors  caused  by  interrupt¬ 
ions  of  the  transmission  path  as  errors  due  to  impulse  noise.  In  this  case  there 
clearly  will  be  no  agreement. 

The  results  of  this  investigation  show  that  when  numerical  methods  are  used, 
polynomial  approximation  should  be  used  as  seldom  and  as  late  in  the  problem  as 
possible.  This  will  lead  to  the  most  accurate  results.  Much  was  gained  not  only  in 
accuracy  but  also  ih  ease  of  calculation  when  numerical  integration  and  differentiation 
rather  than  curve  fitting  was  used  for  the  first  part  of  the  calculations. 
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Based  on  the  calculations  carried  out  in  this  investigation  and  on  experimental 
data  it  was  found  that  the  tail  or  extremal  part  of  p^(u)*The  probability  density  at  the 
output  of  the  integrator  at  the  end  of  the  n'th  bit  intervals, can  be  represented  by 

c 


where  k  =  Z  in  this  investigation.  Since  p^  (u)  is  of  this  simple  form  outside  of  the 
small  center  region,  the  form  of  Pj.J'n)  is  not  influenced  by  the  received  waveshape. 

The  integral  of  the  received  waveshape  determines  the  magnitude  of  and  how 
rapidly  the  sequence  converges  with  increasing  n  values  of  n. 

The  agreement  between  calculations  and  experimental  data  shows  definitely  that 
the  tail  of  is  in  the  form  of  an  invers  e  power  law  rather  than  an  exponential  law.  This 

is  due  to  the  inverse  power  law  for  p(v),  the  probability  density  of  the  peak  amplitude  voltage 

An  approximate  method  was  devised  as  shown  in  the  appendix  by  which  the 
coefficients  can  be  estimated  directly  once  the  integrated  impulse  response  is 
known.  This  method  is  useful  to  obtain  a  first  approximation  to  the  error  rate  that 
can  be  expected  from  a  channel  before  it  is  decided  to  carry  out  more  detailed 
calculations . 

The  estimation  test  carried  out  to  obtain  the  optimum  threshold  for  the  ECD 
is  of  such  a  nature  as  to  keep  the  size  of  the  test  constant  while  minimizing  the 
errors  of  the  second  kind.  The  test  is  therefore  a  uniformly  most  powerful  test. 

The  basic  idea  behind  the  ECD  is  to  concentrate  as  much  as  possible  on  the 
impulse  noise  energy  in  a  few  bit  intervals  as  possible.  Because  of  this,  the  idea 
of  smear-desmear  filters  v/ill  be  of  no  use  here  since  their  action  is  exactly  the 
opposite-  The  use  of  such  filters  combined  with  clipping  in  the  proper  manner, 
smear-channel- equalization- clipping-desmear,  will  probably  give  considerable 
improvement  in  system  performance. 

To  sharpen  the  impulse  response  of  the  channel  for  a  given  bandwidth,  it  is 
very  important  to  keep  the  phase  characteristics  of  the  channel  as  linear  as  possible. 

To  minimize  the  effects  on  the  impulse  response,  the  band-pass  character¬ 
istics  of  the  channel  from  where  the  impulse  enters  the  system  should  be  as  close 
to  cosine  squared  as  possible  since  this  results  in  the  smallest  possible  value  for  M. 

It  has  been  shown  that  integration  and  sampling  of  the  detector  output  is  a 
more  optimum  method  than  direct  sampling  of  the  detector  output  in  thecase  of  a 
telephone  carrier  channel-  This  is  in  general  true  for  any  channel  that  possesses 
a  great  amount  of  phase  distortion  since  in  this  case  part  of  the  impulse  response  is 
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approximately  normal  to  the  signal  over  the  bit  interval.  This  phenomeon  can  be 
used  to  partly  eliminate  the  effects  of  phase  distortion  in  the  channel. 

This  investigation  should  not  be  interpreted  only  as  an  investigation  of  errors 
occurring  in  digital  date  transmission  over  telephone  circuits.  It  should  rather  be 
considered  as  a  general  approach  to  the  problem  where  digital  information  is 
transmitted  over  any  communications  channel  perturbed  by  impulse  noise. 
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Calculation  of  M  for  the  RLC  Channel 
AM  Envelope  Detector  »Systein  I 
Impulse  noise: 

n  (t)  =  A  e  ^  ^QQ  (o)  ^  t  +  0) 

Assume  that  the  detector  is  centered  at  the  center  frequency  of  the  whole  system. 
Signals  : 

One  :  (t)  =  S  cos  w  ^t 

Zero:  S^(t)  =  0 

If  data  is  transmitted  at  the  Nyquist  rate 

g 

S  (t)  =  -y  {1  +  cos  <*>  t)  cos  03  t 
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Case  I 

Impulse  occurs  when  a  string  of  zeros  are  transmitted. 
Detector  output  r  (t). 


r(t)  =  A  e 


•a  (t-T) 


S  . 


Time  required  for  the  noise  burst  to  decay  to  less  than-^-  is  t^ 


S 

'2 


A  e  1 


M  = 


T 


a 


03 

m 


TT 


In 


ZA 


M  = 


1  S 
1  N 


Case  II 

A  string  of  ones  are  transmitted. 

p  (t)  =  A  e  ^  cos  (  03  jt  +  9)  +  S  cos  03  ^t 
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Since  the  channel  is  centered  at  the  carrier  frequency 


CO  .  =  CO 

1  o 

p  (t)  -  A  e  cos  0  *f  S  cos  co  t  -  A  e  ^  *^^sin  9  sin  oo  t 

o  o 


After  detection  and  filtering: 

r  (t)  =  ,^-2  “m  (t-T)  ^  S  9  +  ( |)^ 

r  (t)  takes  on  its  maximuin  value  when  9  =  tt  (Zn+l )  where  n  is  an  integer.  In  this 


/4  \  ^  A  (t-T)  ,  / 

r  (t)  f  A  e  ^ 


r  (t)>  *2  after  a  time  t^  since  the  start  of  the  impulse. 


■  S  _  S  _  ^m^l  ,  S 
2  A  2N  ^  N 


M  =  — 

T 


1  m  ^  S 

"w  ’  TT  YW 

m 


M  =  -  In 

TT  2N 


We  see  that  the  maximum  number  of  bits  in  error  after  the  occur  ranee  of  a 
noise  burst  is  independent  of  whether  a  string  of  zeros  or  ones  were  transmitted 
when  the  noise  burst  occurred. 

Vestigal  Sibeband,  AM,  Synchronous  Detection.  System  II 


The  signal  is  centered  at  o)  . 

3 

One:  S.  (t)  =  -*•  cos  w  t. 


Zero:  S  (t)  =  0. 
o 

Signalling  at  the  Nyquist  rate: 
s  (t)  =  [cos  CO  t  +  cos  {co  -f-  w  )  tl 

'  '  4  L  o  o  m'  J 


Bit  interval  t  = 
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Noise : 

n  (t)  =  A  cos  (to  +  0) 


Where: 


Detector  output,  signal  only, 
c:  S 

2^  (t)  =  TT  +  — C COS  W  t 

8  8  m 

when  a  one  is  transmitted,  m  =  1 

r  (t)  =  I 

Detector  output,  noise  only: 

Before  filtering: 

r  f  (t)  =  A  e  ^  cos  (ca  ^t  +  O)  cos  w  ^t 

-a(t-‘T)  n  /  ,^m 

=  A  e  cos  0  cos  (co  + — * — 

o  2 

.  -  a  (t-T )  .  Q  .  /  ,  ^  m 

-  A  e  '  sin  0  sin  (o)^  *f - ^ — 

After  filtering: 

Since  the  synchronous  detector  is  a  linear  device,  the  performance  of  the  system 
is  not  affected  by  whether  the  signal  is  a  zero  or  a  one. 

Time  required  for  the  noise  output  from  the  demodulator  to  fall  below  half 
the  signal  value,  t^. 


I  t  cos  00  t 
o 


\  t  cos  00  t 
o 


S  _  A  -a  ti 
^  -  T-  ®  ‘ 

IS  __  TT  _  77 

2co  Ja 


M  =  - 


2 

77 


In 


1  s 

4  N 
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AM  Synchronous  Detection*  System  III 
Signal  and  impulse  noise: 

p  (t)  =  ^  (  1  +  m  cos  a>  t)  cos  <*>  t  +  A  co  +0) 

^  mo  o 

Demodulator  output; 

S  ,  A  -a  (t-T)  Q 
r  (t)  “  +  -g-  e  cos  0 

g 

Time  required  for  r  (t)  >  ,  t^. 

S  S  A  -  at  4 


TT  '  CO 


Iv/T  -  ^  1  ^  S 

M  -  -  -  In  ^ 


Phase  Shift  Keying.  Synchronous  Detection.  System  IV 
Signal  and  impulse  noise: 

p  (t)  =  S  m  cos  0)  ^t  +  cos  (co  +  0) 

After  demodulation  before  filtering. 

r  *  (t)  Sm  cos^  co  t  +  A  e"^  t  +  9)  cos  co  t 

O  0  0 

Demodulator  output. 

/,  V  S  m  ,  A  -a  (t-T)  o 
r  (t)  =  — e  '  '  cos  0 

The  most  critical  condition  is  when:  m  =  -1,  cos  0=1. 
Time  required  for  r  (t)<  0  in  this  case,  t^. 

S  A  -a  t. 

I  =  -r  ®  ^ 


^1  =  -  a  In  H 
1,^  _  1 


M  =  _  1  In  ^ 

TT  N 


1  ,  S 

-  In  ^ 

to  N 

m 


54 


Phase  Shift  Keying.  Differential  Phase  Detectoir 

The  differential  phase  detector  is  shown  in  fig.  22. 

S  (t)  =  S  cos  (co  ^t  +  p) 

p  changes  by  tt  from  one  bit  to  the  next  if  a  one  is  transmitted.  If  a  zero  is  trans¬ 
mitted  there  is  no  change. 

X  (t)  =  S  (t)  +  n  (t)  =  S  cos  (co^t  +  p^)  +  A  e  ^  (co^t  +  9) 


Bit  rate:  — 


y  (t)  =  S  cos  (co  t  +  -  CO  t)  +  A  e  ^  f  -  co  t  4  9) 


Z  (t)  =  — ^  cos  (~p2^^o^^ 


+ - cos  (<o  t  4  P.  +  CO  t  +  -  CO  t) 

2  o  i  o  2  o 


+  0“°"  cos  (  0  -  p  +  CO  t) 

2  '  2  o 


SA  (t-T) 

2 


+  V-  e  ■”  '  cos  (2  CO  t  +  P^  -  CO  t) 


SA  -a(t-T-T) 
2 


+  e  ^  ’  cos  (9  -  CO  t  -  p. 


+  -^r —  e  cos  (2  CO  t+9-o)  t  +  P^) 

2  o  o  1 


-a  (2t  -  2T-.  T  ) 


cos  (29  +  2  CO  t  -  w  t) 
o  o 


A  -a(2t-2T-T) 

+ — ^ —  e  cos  CO  t 

2  o 


After  filtering: 

2 

r  (t)  =  ~  cos  (p^  -  P2  +  to^t)+  g-°-(t-T)  _  p^  +  co^t) 


SA  -a(t-T-T) 


+  e 


cos  (9  -  p,  -  CO  t)  + 


S  -a(2t-2T-T) 


cos  CO  t 
o 


since  <o  t  =  2n7r 
o 
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r  (t)  =:  ^  cos  (pj  -  p^)  +  e"”  cos  {0  -  p^) 

,  SA  -a  (t-T-r)  /o  «  i  ,  -a  (2t-2T-T) 

+  -2—  e  '  'cos  (6-Pj.)  +— 2" e  '  ' 


The  worst  case  occurs  when,  zeros  and  ones  alternate.  In  this  case  the  worst 
demodulator  output  is : 


,,,  SA  -at,  SA  -a(t-T)j^  A^  -a  (2t-T ) 

r  (t)  =  -  -2 - j-  e  +  e  '  '  +  — ^  e 


Time  required  for  r  (t)  <  0  is  t^. 

S^  SA  SA  -a(ti-T)  A^  -a(2ti-T) 


T“T" 


"2" 


t  =  -  —  In 

1  Cl 


S  « at 
N® 


^1  -  -s  ^ 

t 


M  = 


m  1  1  -S  ,  4 

In  +  1 


77  W 


N 


M  =  1  -  -  In  ^ 
77  N 


Asymptotic  Expansion  of  y  (t)  for  t>  2.  5  ms. 


The  asymptotic  expres  sion  for  J  (x)  is: 

ir 


Jp  w  X 


2  p  -f  1 

X  -  -  77 


+  R 


whe  r  e : 


’  X  >  >  p  and  I R  ] 


Therefore : 


J  (x)  cos  (x  +  0  ! 

p  V  TTx 


cos  (x  +  “  TZ 


cos  (x  +  ^2)  »  ^7  " 


77 

2  ~  3 
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We  desire  to  find  the  asymptotic  expansion  for: 
1 


V  _  .^5.2  -41  Ot 

y  (t)  “  1 0  t  e 


J  .  (2.  +  J,  (2.  10^  t 


1 

•3 


for  X  >  >  where :  x  =  2 .  1  0^  t  ^  .  t  is  i 


y  (t): 


105t‘/2,-410t/l^_  ^-3/ 

-I 


5  4-1 

y(t)RilO  t  ^ 


TT  .  i  0 

41  Ot 


in  seconds . 
cos  (2.  10^  ^  +  0)  +  cos  (2 


.  +  e. 


1  0  ^TT 


COS  (2.  I'o^  t  +  y) 


Since  the  bit  rate  is  1000  bits  per  second  it  was  decided  that  it  is  more  convenient 
to  use  ms  as  a  time  unit.  Upon  this  change  of  variable  we  obtain 

y  (t)  =  A  e" '  t  ^cos  (6.3  t^^^  4  y) 

for  t  >  2>  4  ms 


upon  evaluation  of  A  and  y  we  obtain 

1 


y{t)  =  -  .526t'^e  ’"^^^cos  6.3  t^^  ^  .  7 


Break  point  for  p^  (u) 


“  -0024  =  .  888  mv 

1  imax  min 
-4 

p^  (u)  =  ^ —  fo3r  |u  1  ^  .888  mv  =  .  888.10  ^ 

u 

Break  points  for  p^  (u) 


(u)  =  1.  for  |u|  >  1.  332.  10"^ 

u 

upper  break  point  of  p^  (u): 

=  Z.  V  .  =  .5532  .  .  0024  =  1.  332  mv 

2  2  max  min 

Lower  break  point  of  p^  (u) 

u;  =  Z.  V  .  =  ,  098  .  .  0024  =  .  266  mv 

2  2  min  min 

p2  (^)  ~  Q  I  "^2 
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P2 


(u)  =  /  p,  (z)  tV"  p 


dv 


where : 


=  Max  of  <  V _ .  of 


min 


b  =  Min  of  <00  or 


Z  . 

min 


where  z  =  — 


(z  )  -  2586  -  10918  +  13839  -  7805  z' 


^  6 

2 


p  (v) 


+  2145  -*  2682  +  12.71 

.  0024 


,  ^  .  0024  I  2587  u,^  _  ^  4  _  ^  3 

Pz  "" - T  I  “T~  '  v' - 7  V'  5  V'  5  V 


2145  ,uv^  268  ,uv  ,  ^2.71 

I;;'  "  W  2 


.  098 


~A —  w  3  'v 


V  =  Max  of  .  0024  or 

P2{u)=0for:^<.0024  oru<.236  mv 
Approximate  evaluation  of  pCu) 

P{2) 


p  (u/  V  ;  - 


Pl  ( 


p  (u)  =  /  p  (u/  V  )  P  (v  )  dv 

V  . 

min 
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For ;  u 


>  Z 


V  .  —  max 

min 


oo 


(u)  =  /  p  (u/v  )  p  (v  )  dv  =  ^  =  /  4"  Pi 


e  V 


max 


~1 
u  u 

Z 

max 


dv 


p,,^,  SI  =.V^  / 


p  (u)  =  e  V 


u _ 

max 

a 

n 


a  (  ~)  +  .  .  •  a 

n  v'  o 


dv 


n  a  .  n- 1  a^  a 

(Z^.J  +-^  Z  .  +  ° 


- 7-*-  IjLi  t  X  -  l/L. 

n+2  max  n  +  1  max 
2 


T' 


G  V  Z 

/  X  o  max  /„  V 

p  (u)  « - 2 -  P 

u 


To  obtain  an  approximate  expression  for  p  (u),  proceed  as  follows: 


calc  mate  Z 

•  max 

calciilate  the  break  point:  Ut^  =  Z  V  . 

^  B  max  min 


evaluate  p  (Z  ) 

^  max 

p  (u)is  given  by  eq-  6  for  |u|  >  u-q 


Example.  First  Interval 


Pi  (z 

G  V 


=  •  1 


max 
.  0024 


Z  =  .  19 

max  o  - 
p  (u) - ^ 


lO  ^  for  lul  >  4.56.  10  ^ 


Estimation  of  required  row  length 

To  insure  independence  between  errors  in  the  columns  we  will  require  the  row 
to  be  4  4  1  bit  long.  The  value  of  is  choosen  such  that  the  possibility  of 

corrupted  bits  occur  sufficiently  seldom. 

It  has  been  decided  that  the  condition  for  corrupted  bits  to  occur  should 
exist  only  lO"^  of  the  one  second  intervals.  From  curve  II  fig-V  we  can  extrapolate 
that  this  corresponds  to  an  impulse  of  peak  amplitude  of  80  db.  Since  the  transmitted 
amplitude. 
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g 

is  -4  db. ,  this  corresponds  to  a  =  -84  db.  From  fig.  6  we  see  that  this  corresponds 
with  a  row  length  of  25  bits. 

Error  Calculations.  The  ECD 


a  =  2.  10 


-7 


P  =  1.5.  10 


-4 


.5.10 


,-4/*  =  .132.10-'' 


E 


P=4  -  32 


.  10“".  10^  =  .57.  10“'^ 


Ep_  ^  is  small 


|2.  1E|  =  2.  lO"”^  (1.5.  10"^) 


32.  21. 30  _  2.23.10"" 


_  2.23  10"'^=  7  10"^ 

^a|3 - 32“  • 


p^|2  e|  =  (2.  10"^)  -g--  =  2.10 


„-ll 


E  =  4°.  10-9 

a  32 


,  63.  10' 


E  =  E  +  E„  +  E^„ 
a  p  ap 


E  =  1.9.10 


-9 
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The  situation  when  a  one  is  transmitted. 


RELATIVE 
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Fig.  4  Average  enevelope  delay  for  links  ^  Average  attenuation  of  four  links 

of  type  N  carrier  circuits  N  carrier 
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Fig. 8  Normalized  impulse  response  of  a  type  N  telephone  carrier  system. 
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INTEGRATOR  OUTPUT  INTEGRATOR  OUTPUT 


Fig.  9 


Fig.  10  Time  of  occurrence  of  the  impulse  referred  to  the  first  bit  interval. 


Fig.  11  (z) 


M.R.I.-I8845 


(z)  obtained  by  numerical  methods 
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Fig»  15.  Probability  density  at  the  integrator  output  during 
the  first  bit  interval  subject  to  the  condition  that 
an  impulse  with  an  amplitude  response  of  at  least 
0.  0024  has  occurred  in  the  channel. 
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Fig.  16.  Probability  density  at  the  integrator  output  when  an 
impulse  with  a  response  of  at  least  0.  0024  volt  was 
picked  up  by  the  channel  in  the  preceeding  bit  interval. 


of  errors  of  the  first  kind. 
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INTEGRATOR  RESET 

Fig. 20  The  ECO  Sy$tem  Receiver 
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Fig.  21  The  Eight  Possible  Numbers  Represented  by  abc 


Fig.22.  Differential  Phase  Detector 
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Fig.  24 
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